00000001:02000400:3.0F:1787864748.878984:0:2970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787864765.209643:0:3191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787864766.780328:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 751 MB/s 00000001:01000000:3.0:1787864767.031169:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 835 MB/s 00000001:01000000:2.0:1787864767.280491:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7807 MB/s 00000020:02000000:1.0F:1787864767.941737:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_gb165317 00000400:02000000:2.0:1787864768.812373:0:3299:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.110@tcp [8/256/0/180] 00008000:02000000:2.0:1787864772.087855:0:3448:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787864812.993268:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787864820.740909:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787864820.740914:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787864820.741058:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b03360a1 00000080:02000400:3.0:1787864820.741068:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787864820.744599:0:5830:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787864820.744611:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787864820.744647:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b2f0892c) 00000020:00000080:3.0:1787864820.744667:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787864820.761205:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787864820.762010:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0F:1787864820.783257:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787864820.783302:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787864820.783323:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787864820.783374:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787864820.785102:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787864820.785702:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787864820.785710:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787864820.785718:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe186191639 00000020:01000004:0.0:1787864820.785725:0:5830:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787864820.785729:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787864820.785733:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b03360a1 from MGS 00000020:01000004:0.0:1787864820.785737:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787864820.785753:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cd9d1622) 00000020:00000080:0.0:1787864820.785762:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787864820.785913:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b03360a1 from MGS, refs=2 00080000:01000000:0.0:1787864820.785917:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787864820.785921:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe186191647 00000100:00100000:0.0:1787864820.786001:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787864820.786115:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787864820.786120:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787864820.786873:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787864820.786881:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787864820.787739:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864820.787967:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787864820.787972:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787864820.788550:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787864820.788558:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787864820.789367:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787864820.789378:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787864820.790918:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864820.790922:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864820.790924:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864820.791253:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864820.791261:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864820.791263:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864820.797903:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787864820.802720:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787864821.047722:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3323 MB/s 00000001:01000000:2.0:1787864821.297857:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4751 MB/s 00000001:01000000:2.0:1787864821.549195:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 645 MB/s 00000001:01000000:2.0:1787864821.799009:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 831 MB/s 00080000:10000000:2.0:1787864821.810622:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787864821.823848:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787864821.829577:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787864821.829603:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787864821.829606:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787864821.830863:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787864821.831020:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787864821.831070:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787864821.831273:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787864821.831301:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787864821.831731:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787864821.831882:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787864821.831888:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787864821.835196:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787864821.835210:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787864821.842533:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787864821.842553:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787864821.843617:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787864821.843638:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:3.0:1787864821.843639:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787864821.843698:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:3.0:1787864821.843708:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (0000000018880151) 00000020:00000080:3.0:1787864821.843727:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787864821.843803:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009dacbba4@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00010000:00010000:3.0:1787864821.843987:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:3.0:1787864821.843994:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787864821.844568:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787864821.846606:0:5846:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787864821.846892:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid 0743acf0-ff0b-46d8-9d09-7d582be6a838) 00000020:00000080:2.0:1787864821.846916:0:5830:0:(genops.c:1385:class_connect()) connect: client 0743acf0-ff0b-46d8-9d09-7d582be6a838, cookie 0xa63eebe186191655 00000100:00080000:2.0:1787864821.846927:0:5830:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864821.846933:0:5830:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import 000000009dacbba4 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787864821.846962:0:5830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000840e358 x1874712086970496/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864821.850216:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000840e358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0743acf0-ff0b-46d8-9d09-7d582be6a838:3314:1874712086970496:0@lo:250: 00000100:00100000:0.0:1787864821.850306:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787864821.850377:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0743acf0-ff0b-46d8-9d09-7d582be6a838->MGS 00000020:01000004:2.0:1787864821.850418:0:5830:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787864821.850437:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787864821.850457:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000790f5552) 00000020:00000080:2.0:1787864821.850472:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787864821.856444:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086970496 00000100:00100000:0.0:1787864821.856587:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086970496 00000100:00100000:0.0:1787864821.856705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864821.856712:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009ed4b46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1874712086970496:12345-0@lo:250: 00010000:00080000:0.0:1787864821.856738:0:5841:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 0743acf0-ff0b-46d8-9d09-7d582be6a838@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:0.0:1787864821.856765:0:5841:0:(genops.c:1385:class_connect()) connect: client 0743acf0-ff0b-46d8-9d09-7d582be6a838, cookie 0xa63eebe186191663 00000100:00080000:0.0:1787864821.857223:0:5841:0:(import.c:65:import_set_state_nolock()) 000000008698c949 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864821.858291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009ed4b46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:3314:x1874712086970496:12345-0@lo:250: Request processed in 1574us (7981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.858302:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864821.862518:0:3314:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787864821.862535:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:1.0:1787864821.862543:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787864821.862548:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787864821.862552:0:3314:0:(import.c:65:import_set_state_nolock()) 000000009dacbba4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787864821.862555:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787864821.862564:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787864821.862571:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000840e358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0743acf0-ff0b-46d8-9d09-7d582be6a838:3314:1874712086970496:0@lo:250: 00000100:00100000:3.0:1787864821.880955:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864821.881207:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787864821.881213:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787864821.883470:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787864821.883484:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787864821.884078:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787864821.884086:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787864821.889248:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864821.892049:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787864821.892059:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787864821.895518:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787864821.895537:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787864821.936263:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864821.936528:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787864821.936535:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787864821.937515:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787864821.937524:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787864821.938084:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864821.938233:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787864821.938238:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787864821.938748:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787864821.938754:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787864821.939270:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864821.939569:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787864821.939575:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787864821.940000:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787864821.940007:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787864821.940513:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864821.940663:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787864821.940668:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787864821.941062:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787864821.941073:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787864821.957074:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864821.958268:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787864821.958276:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787864821.959942:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787864821.959955:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787864821.961260:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787864821.961273:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787864821.962873:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787864821.962897:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787864821.962903:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787864821.963043:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787864821.963074:0:5830:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787864821.963078:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787864821.963080:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864821.963081:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864821.963082:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864821.963083:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864821.963084:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864821.963085:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864821.963087:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864821.963088:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864821.963089:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864821.963091:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864821.963092:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864821.963094:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787864821.963096:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864821.963097:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864821.963098:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864821.963099:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864821.963100:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864821.963101:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864821.963102:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864821.963103:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864821.963104:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864821.963105:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864821.963106:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864821.963107:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864821.963135:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787864821.963150:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bced5056 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970624:0@lo:253: 00000100:00100000:0.0:1787864821.963218:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.963272:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb47d458 going to sleep for 11 seconds 00000100:00100000:1.0:1787864821.963346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086970624 00000100:00100000:1.0:1787864821.963352:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086970624 00000100:00100000:1.0:1787864821.963501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864821.963508:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1111442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:5830:x1874712086970624:12345-0@lo:253: 20000000:01000000:1.0:1787864821.963548:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787864821.963550:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787864821.963945:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787864821.963996:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787864821.964528:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864821.965392:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787864821.965707:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787864821.965711:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787864821.965716:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787864821.965718:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787864821.965732:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787864821.965988:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864821.966201:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787864821.966213:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787864821.966259:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787864821.966306:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787864821.966340:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787864821.966469:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787864821.966478:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787864821.966538:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787864821.966546:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787864821.966578:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787864821.966585:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787864821.966611:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787864821.966669:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787864821.966700:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787864821.966705:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787864821.966718:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864821.966912:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787864821.966922:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787864821.966953:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787864821.966983:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787864821.967023:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787864821.967033:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787864821.967110:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787864821.967119:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787864821.967158:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787864821.967193:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787864821.967225:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787864821.967235:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787864821.967324:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787864821.967333:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787864821.967364:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787864821.967462:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787864821.967647:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787864821.967698:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787864821.967706:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787864821.968267:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787864821.968636:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787864821.968655:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.110@tcp for mdt 20000000:01000000:3.0:1787864821.968658:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:3.0:1787864821.968690:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787864821.968698:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787864821.968725:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787864821.968731:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:3.0:1787864821.968784:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787864821.968795:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787864821.968834:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787864821.968864:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787864821.968915:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787864821.968918:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787864821.968921:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787864821.968930:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787864821.968932:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787864821.968958:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787864821.968960:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787864821.969287:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787864821.969598:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787864821.969637:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787864821.969669:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787864821.969681:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787864821.969682:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787864821.970748:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787864821.970993:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787864821.971031:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787864821.971141:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787864821.971155:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864821.971157:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787864821.971162:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787864821.971164:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787864821.971170:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787864821.971177:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787864821.972118:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787864821.972249:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787864821.978019:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787864821.978078:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787864821.978158:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787864821.978182:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864821.978203:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978237:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978246:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978251:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978256:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978262:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978267:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006faca205 already unused, calling callback (0000000036c68305) 00010000:00010000:3.0:1787864821.978270:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978276:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978288:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978294:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.978299:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006faca205/0xa63eebe18619166a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787864821.978327:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787864822.145321:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1111442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:5830:x1874712086970624:12345-0@lo:253: Request processed in 181806us (182095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.145348:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864822.145517:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bced5056 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970624:0@lo:253: 10000000:01000000:3.0:1787864822.145533:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787864822.145536:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864822.145538:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787864822.145539:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864822.145540:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787864822.145541:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864822.145543:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864822.145544:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864822.145545:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787864822.145547:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787864822.145548:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864822.145549:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787864822.145570:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b03360a1 from lustre-MDT0000 10000000:01000000:3.0:1787864822.145593:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787864822.145596:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787864822.145600:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa210db4ed8 10000000:01000000:3.0:1787864822.145604:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864822.145613:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa210db4ed8 from 1 10000000:01000000:3.0:1787864822.145616:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787864822.145652:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.145662:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.145669:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864822.145687:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ff3f62b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970752:0@lo:101: 00000100:00100000:3.0:1787864822.145842:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.145898:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8dadcf4 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.145984:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086970752 00000100:00100000:0.0:1787864822.145990:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086970752 00000100:00100000:0.0:1787864822.146030:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864822.146037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d8472f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:5830:x1874712086970752:12345-0@lo:101: 00010000:00010000:0.0:1787864822.146049:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864822.146060:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191671 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.146082:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191671 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.146091:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191671 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.146098:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f54b8702, rc 0) 00000100:00100000:0.0:1787864822.146140:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d8472f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5830:x1874712086970752:12345-0@lo:101: Request processed in 104us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.146147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864822.146219:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ff3f62b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970752:0@lo:101: 00010000:00010000:1.0:1787864822.146234:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.146251:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.146297:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970880:0@lo:501: 00000100:00100000:1.0:1787864822.146322:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.146352:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cac448d4 going to sleep for 11 seconds 00000100:00100000:3.0:1787864822.146476:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086970880 00000100:00100000:3.0:1787864822.146481:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086970880 00000100:00100000:3.0:1787864822.146511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864822.146517:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004332a9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5830:x1874712086970880:12345-0@lo:501: 00000100:00100000:3.0:1787864822.146718:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004332a9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5830:x1874712086970880:12345-0@lo:501: Request processed in 202us (395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864822.146725:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864822.146895:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086970880:0@lo:501: 10000000:01000000:1.0:1787864822.146918:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787864822.146937:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.146944:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864822.146952:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa2100e4000 10000000:01000000:1.0:1787864822.146956:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787864822.146960:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa2100e4000 10000000:01000000:1.0:1787864822.146962:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787864822.146964:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa2100e4000 from 1 10000000:01000000:1.0:1787864822.146966:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787864822.146983:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.146989:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.146996:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.147017:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971008:0@lo:101: 00000100:00100000:1.0:1787864822.147043:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.147073:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cac448d4 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.147127:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971008 00000100:00100000:0.0:1787864822.147137:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971008 00000100:00100000:0.0:1787864822.147169:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864822.147175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f04e952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5830:x1874712086971008:12345-0@lo:101: 00010000:00010000:0.0:1787864822.147182:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864822.147192:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a97c99c1/0xa63eebe186191686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619167f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147207:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a97c99c1/0xa63eebe186191686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619167f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147215:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a97c99c1/0xa63eebe186191686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619167f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147221:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a97c99c1, rc 0) 00000100:00100000:0.0:1787864822.147249:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f04e952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:5830:x1874712086971008:12345-0@lo:101: Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.147255:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864822.147327:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971008:0@lo:101: 00010000:00010000:1.0:1787864822.147446:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.147454:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864822.147465:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787864822.147467:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.147473:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000cbf79ac5/0xa63eebe18619167f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864822.147478:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787864822.147481:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864822.147485:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa2100e4000 10000000:01000000:1.0:1787864822.147488:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787864822.147490:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787864822.147492:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787864822.147504:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.147509:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.147525:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.147537:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971136:0@lo:101: 00000100:00100000:1.0:1787864822.147561:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.147577:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cac448d4 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.147657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971136 00000100:00100000:0.0:1787864822.147660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971136 00000100:00100000:0.0:1787864822.147686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864822.147691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002386af22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:5830:x1874712086971136:12345-0@lo:101: 00010000:00010000:0.0:1787864822.147697:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864822.147704:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619168d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147716:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619168d expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147723:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619168d expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.147739:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce9d1306, rc 0) 00000100:00100000:0.0:1787864822.147857:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002386af22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:5830:x1874712086971136:12345-0@lo:101: Request processed in 166us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.147864:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864822.147919:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971136:0@lo:101: 00010000:00010000:1.0:1787864822.147928:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.147935:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.147978:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971264:0@lo:501: 00000100:00100000:1.0:1787864822.147998:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.148016:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cac448d4 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.148153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971264 00000100:00100000:0.0:1787864822.148157:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971264 00000100:00100000:0.0:1787864822.148182:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864822.148187:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6882f4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:5830:x1874712086971264:12345-0@lo:501: 00000100:00100000:0.0:1787864822.148528:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6882f4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5830:x1874712086971264:12345-0@lo:501: Request processed in 340us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.148534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864822.148596:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971264:0@lo:501: 00000100:00100000:1.0:1787864822.148619:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971392:0@lo:503: 00000100:00100000:1.0:1787864822.148649:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.148672:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cac448d4 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.148714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971392 00000100:00100000:0.0:1787864822.148718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971392 00000100:00100000:0.0:1787864822.148831:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864822.148837:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b6ccbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5830:x1874712086971392:12345-0@lo:503: 00000100:00100000:0.0:1787864822.148970:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b6ccbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5830:x1874712086971392:12345-0@lo:503: Request processed in 133us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.148976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864822.149030:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971392:0@lo:503: 00000100:00100000:3.0:1787864822.149632:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5873:1874712086971520:0@lo:502: 00000100:00100000:3.0:1787864822.149672:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.149730:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047b4e743 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.149819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971520 00000100:00100000:0.0:1787864822.149823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971520 00000100:00100000:0.0:1787864822.149879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864822.149885:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c39c1f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5873:x1874712086971520:12345-0@lo:502: 00000100:00100000:0.0:1787864822.150078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c39c1f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5873:x1874712086971520:12345-0@lo:502: Request processed in 193us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.150085:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864822.150421:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5873:1874712086971520:0@lo:502: 00000020:01000000:1.0:1787864822.150456:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864822.150466:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864822.150468:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787864822.150479:0:5873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787864822.150482:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864822.150501:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000de1cf083) 00000020:00000080:1.0:1787864822.150516:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787864822.150522:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787864822.150593:0:5873:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787864822.150599:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861916a2 00000020:00000080:1.0:1787864822.150878:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787864822.150882:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864822.150886:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864822.150887:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787864822.150889:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864822.150893:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864822.150894:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787864822.150897:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864822.150904:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f49bf800) 00000020:00000080:1.0:1787864822.150912:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787864822.150915:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787864822.150917:0:5873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787864822.150919:0:5873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787864822.150924:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787864822.150974:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b03360a1 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787864822.150984:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c27d4c70) 00000020:00000080:1.0:1787864822.150991:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787864822.151032:0:5873:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787864822.151036:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe1861916b7 00000020:00000080:1.0:1787864822.151128:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787864822.151133:0:5873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787864822.151137:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa63eebe1861916be 00080000:01000000:1.0:1787864822.151141:0:5873:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787864822.151144:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861916c5 00080000:10000000:1.0:1787864822.151968:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787864822.152179:0:5873:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787864822.157583:0:5873:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787864822.220646:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787864822.221040:0:5873:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787864822.226523:0:5873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787864822.226879:0:5873:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787864822.274141:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d7beef03) 00000020:00000080:0.0:1787864822.274165:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787864822.274221:0:5873:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787864822.274236:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861916d3 00000020:00000080:0.0:1787864822.278151:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787864822.279320:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787864822.309664:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.329320:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787864822.354281:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787864822.382276:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787864822.408346:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787864822.439856:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa63eebe1861916da 00000020:00000080:3.0:1787864822.440096:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787864822.440106:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864822.440113:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864822.440115:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787864822.440118:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864822.440122:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864822.440123:0:5873:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864822.440126:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864822.440127:0:5873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787864822.440129:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864822.440131:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864822.440132:0:5873:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787864822.440134:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864822.440145:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864822.440146:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787864822.440150:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787864822.440183:0:5873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787864822.440234:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043e8195a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5873:1874712086971648:0@lo:502: 00000100:00100000:3.0:1787864822.440308:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.440346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971648 00000100:00100000:3.0:1787864822.440351:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971648 00000100:00100000:3.0:1787864822.440386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864822.440393:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bb6d69d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5873:x1874712086971648:12345-0@lo:502: 00000100:00100000:2.0:1787864822.441663:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fc3f944 going to sleep for 11 seconds 00000100:00100000:3.0:1787864822.441904:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bb6d69d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5873:x1874712086971648:12345-0@lo:502: Request processed in 1510us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.441914:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864822.442194:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043e8195a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5873:1874712086971648:0@lo:502: 00000020:01000000:2.0:1787864822.442227:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864822.442233:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864822.442235:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787864822.442239:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787864822.442569:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787864822.442588:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787864822.442636:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.442647:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864822.442655:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2100e4000 from 1 10000000:01000000:1.0:1787864822.442657:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787864822.442684:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.442690:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.442698:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.442712:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971776:0@lo:101: 00000100:00100000:1.0:1787864822.442747:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.442781:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000007efe18b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.442870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971776 00000100:00100000:0.0:1787864822.442877:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971776 00000100:00100000:0.0:1787864822.442913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864822.442920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9655f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:5830:x1874712086971776:12345-0@lo:101: 00010000:00010000:0.0:1787864822.442930:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864822.442941:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861916e1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.442959:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.442968:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.442975:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b92341a, rc 0) 00000100:00100000:0.0:1787864822.443011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9655f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:5830:x1874712086971776:12345-0@lo:101: Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.443017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864822.443076:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971776:0@lo:101: 00010000:00010000:2.0:1787864822.443087:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.443094:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864822.443636:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971904:0@lo:256: 00000100:00100000:2.0:1787864822.443684:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864822.443703:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b2d092 going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.443843:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086971904 00000100:00100000:1.0:1787864822.443848:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086971904 00000100:00100000:1.0:1787864822.443880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864822.443891:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eef0034c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:5830:x1874712086971904:12345-0@lo:256: 20000000:01000000:1.0:1787864822.443903:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787864822.443908:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787864822.443957:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eef0034c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:5830:x1874712086971904:12345-0@lo:256: Request processed in 67us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.443963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864822.444058:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086971904:0@lo:256: 10000000:01000000:2.0:1787864822.444625:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864822.444865:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.444875:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864822.444882:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2100e4000 from 1 10000000:01000000:2.0:1787864822.444885:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864822.444916:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.444921:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.444929:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864822.444942:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972032:0@lo:101: 00000100:00100000:2.0:1787864822.444977:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864822.445009:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b2d092 going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.445064:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972032 00000100:00100000:1.0:1787864822.445070:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972032 00000100:00100000:1.0:1787864822.445107:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864822.445114:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de2ed1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:5830:x1874712086972032:12345-0@lo:101: 00010000:00010000:1.0:1787864822.445123:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864822.445135:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861916ef expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.445152:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861916ef expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.445161:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916ef expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.445168:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2878b15, rc 0) 00000100:00100000:1.0:1787864822.445211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de2ed1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972032:12345-0@lo:101: Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.445217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864822.445288:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972032:0@lo:101: 00010000:00010000:2.0:1787864822.445301:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.445317:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864822.445364:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972160:0@lo:501: 00000100:00100000:2.0:1787864822.445387:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864822.445445:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b2d092 going to sleep for 11 seconds 00000100:00100000:0.0:1787864822.445497:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972160 00000100:00100000:0.0:1787864822.445502:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972160 00000100:00100000:0.0:1787864822.445542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787864822.445547:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a024bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972160:12345-0@lo:501: 00000100:00100000:0.0:1787864822.446330:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a024bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972160:12345-0@lo:501: Request processed in 781us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.446344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864822.446356:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972160:0@lo:501: 00000100:00100000:2.0:1787864822.446385:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972288:0@lo:503: 00000100:00100000:2.0:1787864822.446469:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.446487:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972288 00000100:00100000:2.0:1787864822.446489:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b2d092 going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.446492:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972288 00000100:00100000:1.0:1787864822.446520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864822.446526:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dca8dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972288:12345-0@lo:503: 00000040:00080000:1.0:1787864822.446622:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864822.446674:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dca8dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972288:12345-0@lo:503: Request processed in 149us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.446681:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864822.446748:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724dc069 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972288:0@lo:503: 00000040:00080000:2.0:1787864822.447957:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787864822.448116:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787864822.448132:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864822.448153:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.448165:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864822.448209:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787864822.448212:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa2100e4000 10000000:01000000:0.0:1787864822.448214:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa2100e4000 10000000:01000000:0.0:1787864822.448218:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864822.448225:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2100e4000 from 1 10000000:01000000:0.0:1787864822.448227:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864822.448255:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.448261:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.448269:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864822.448285:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972416:0@lo:101: 00000100:00100000:0.0:1787864822.448329:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.448450:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c8e94c going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.448632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972416 00000100:00100000:1.0:1787864822.448638:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972416 00000100:00100000:1.0:1787864822.448691:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864822.448699:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007717f334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086972416:12345-0@lo:101: 00010000:00010000:1.0:1787864822.448710:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864822.448720:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861916fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.448743:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861916fd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.448752:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916fd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.448769:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000135a931b, rc 0) 00000100:00100000:1.0:1787864822.448808:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007717f334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086972416:12345-0@lo:101: Request processed in 110us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.448814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864822.449037:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972416:0@lo:101: 00010000:00010000:0.0:1787864822.449049:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.449070:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864822.449119:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972544:0@lo:501: 00000100:00100000:0.0:1787864822.449146:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.449168:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c8e94c going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.449225:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972544 00000100:00100000:1.0:1787864822.449230:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972544 00000100:00100000:1.0:1787864822.449260:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864822.449266:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c787fb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086972544:12345-0@lo:501: 00000100:00100000:1.0:1787864822.449515:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c787fb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086972544:12345-0@lo:501: Request processed in 239us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.449522:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864822.449608:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972544:0@lo:501: 00000100:00100000:0.0:1787864822.449632:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972672:0@lo:503: 00000100:00100000:0.0:1787864822.449667:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.449686:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c8e94c going to sleep for 11 seconds 00000100:00100000:3.0:1787864822.449731:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972672 00000100:00100000:3.0:1787864822.449736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972672 00000100:00100000:3.0:1787864822.449770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787864822.449776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a8060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086972672:12345-0@lo:503: 00000100:00100000:3.0:1787864822.450152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a8060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086972672:12345-0@lo:503: Request processed in 375us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.450159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864822.450675:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077f1bf7c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086972672:0@lo:503: 00000100:00100000:3.0:1787864822.451187:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5878:1874712086972800:0@lo:502: 00000100:00100000:3.0:1787864822.451234:0:5878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.451274:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e124ec5 going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.451544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972800 00000100:00100000:1.0:1787864822.451555:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972800 00000100:00100000:1.0:1787864822.451626:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787864822.451633:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075383736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5878:x1874712086972800:12345-0@lo:502: 00000100:00100000:1.0:1787864822.452114:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075383736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5878:x1874712086972800:12345-0@lo:502: Request processed in 482us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864822.452123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864822.452234:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5878:1874712086972800:0@lo:502: 00000020:01000004:3.0:1787864822.452294:0:5878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787864822.452308:0:5878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001dcbdca2) 00000020:00000080:3.0:1787864822.452324:0:5878:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787864822.452466:0:5878:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b03360a1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787864822.452470:0:5878:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b03360a1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787864822.452473:0:5878:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b03360a1 4 00010000:00080000:3.0:1787864822.452500:0:5878:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000756bcf63@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:3.0:1787864822.455262:0:5878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787864822.455604:0:5878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787864822.455749:0:5878:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787864822.455763:0:5878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa63eebe186191712 00000100:00080000:3.0:1787864822.455772:0:5878:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864822.455776:0:5878:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000756bcf63 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787864822.455806:0:5878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000419d20f1 x1874712086972928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864822.455926:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712086972928:0@lo:38: 00000100:00100000:0.0:1787864822.456008:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787864822.456180:0:5878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787864822.456750:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086972928 00000100:00100000:0.0:1787864822.456759:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086972928 00000100:00100000:0.0:1787864822.456907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864822.456914:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077f1bf7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1874712086972928:12345-0@lo:38: 00000100:00100000:0.0:1787864822.456986:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077f1bf7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1874712086972928:12345-0@lo:38: Request processed in 71us (979us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787864822.456992:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864822.457093:0:5878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016a79b77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5878:1874712086973056:0@lo:502: 00000100:00100000:3.0:1787864822.457140:0:5878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.457164:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973056 00000100:00100000:3.0:1787864822.457168:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973056 00000100:00100000:3.0:1787864822.457196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864822.457203:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007288ec86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5878:x1874712086973056:12345-0@lo:502: 00000100:00100000:3.0:1787864822.457455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007288ec86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5878:x1874712086973056:12345-0@lo:502: Request processed in 253us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.457463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864822.457510:0:5878:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ab0d3fe going to sleep for 11 seconds 00000100:00100000:3.0:1787864822.457526:0:5878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016a79b77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:5878:1874712086973056:0@lo:502: 00000040:00080000:3.0:1787864822.457550:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1787864822.458055:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864822.458062:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000756bcf63 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864822.458067:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787864822.458070:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712086972928:0@lo:38: 00000020:01000000:0.0:1787864822.458101:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787864822.458122:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787864822.458156:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864822.458173:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787864822.458225:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787864822.458228:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864822.458229:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864822.458230:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864822.458232:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864822.458233:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864822.458234:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864822.458236:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864822.458237:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864822.458239:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864822.458240:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864822.458242:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864822.458245:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787864822.458248:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864822.458250:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864822.458251:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864822.458252:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864822.458253:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864822.458254:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864822.458255:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864822.458256:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864822.458257:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864822.458258:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864822.458259:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864822.458260:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864822.458274:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787864822.458282:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b483c8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086973184:0@lo:253: 00000100:00100000:0.0:1787864822.458317:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.458418:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000815a2431 going to sleep for 11 seconds 00000100:00100000:1.0:1787864822.458524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973184 00000100:00100000:1.0:1787864822.458530:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973184 00000100:00100000:1.0:1787864822.458596:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864822.458604:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc485be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5830:x1874712086973184:12345-0@lo:253: 20000000:01000000:1.0:1787864822.458625:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787864822.458637:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787864822.502088:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787864822.502134:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787864822.503963:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787864822.503972:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787864822.503992:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.504009:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.504017:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.504052:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.504065:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 12 pid: 5844 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.504079:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6399570 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086973312:0@lo:104: 00000100:00100000:1.0:1787864822.504146:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864822.504205:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000004999e50f going to sleep for 11 seconds 00000100:00100000:3.0:1787864822.504300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973312 00000100:00100000:3.0:1787864822.504307:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973312 00000100:00100000:3.0:1787864822.504353:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864822.504361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e13e55f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086973312:12345-0@lo:104: 00010000:00010000:3.0:1787864822.504371:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504459:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787864822.504463:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e13e55f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086973312:12345-0@lo:104: Request processed in 104us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.504471:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787864822.504490:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864822.504495:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504503:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b45ad9dd already unused, calling callback (00000000add81c8d) 10000000:00010000:3.0:1787864822.504506:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504512:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864822.504518:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864822.504522:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864822.504545:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504550:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864822.504572:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504578:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000b45ad9dd/0xa63eebe1861916e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864822.504592:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864822.504594:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864822.504595:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864822.504832:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016a79b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086973440:0@lo:103: 00000100:00100000:3.0:1787864822.504931:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864822.505049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973440 00000100:00100000:2.0:1787864822.505054:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973440 00010000:00010000:2.0:1787864822.505074:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 13 pid: 5844 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864822.505106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864822.505113:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed1fd0c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3316:x1874712086973440:12345-0@lo:103: 00010000:00010000:2.0:1787864822.505123:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864822.505127:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 13 pid: 5844 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505137:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 13 pid: 5844 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505163:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505170:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864822.505182:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001210832s 00010000:00010000:2.0:1787864822.505185:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505191:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505197:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505202:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505208:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1af5c1d already unused, calling callback (0000000036c68305) 00010000:00010000:2.0:1787864822.505211:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505217:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505224:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864822.505233:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864822.505261:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed1fd0c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3316:x1874712086973440:12345-0@lo:103: Request processed in 150us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864822.505287:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864822.505319:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016a79b77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086973440:0@lo:103: 00010000:00010000:1.0:1787864822.505392:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b92341a/0xa63eebe1861916e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861916e1 expref: 12 pid: 5844 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864822.505431:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6399570 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086973312:0@lo:104: 00010000:00010000:1.0:1787864822.505447:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.505454:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.505459:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864822.505464:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1af5c1d/0xa63eebe186191719 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864822.512358:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc485be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5830:x1874712086973184:12345-0@lo:253: Request processed in 53746us (54031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.512373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864822.512617:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b483c8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:5830:1874712086973184:0@lo:253: 10000000:01000000:0.0:1787864822.512632:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787864822.512712:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787864822.512714:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864822.512716:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864822.512717:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864822.512718:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864822.512720:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864822.512721:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864822.512723:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864822.512724:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864822.512725:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864822.512727:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864822.512728:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787864822.512747:0:5830:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787864822.519337:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.520092:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787864822.520299:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.520507:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787864822.520924:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.521082:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787864822.522187:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.522436:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787864822.522725:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.523748:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787864822.526488:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787864822.526976:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787864822.575844:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787864822.617626:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787864822.617761:0:5883:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787864822.617765:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787864822.618046:0:5884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787864822.620642:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787864822.620803:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787864822.621211:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787864822.621219:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787864822.621348:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864822.627119:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787864822.627678:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787864822.627712:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787864822.628265:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787864822.628662:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787864822.635087:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787864822.635227:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787864822.635365:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787864822.635534:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787864822.635673:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787864822.635824:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787864822.635961:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787864822.636112:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787864822.636261:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787864822.636386:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787864822.637094:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787864822.637229:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787864822.637381:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787864822.637836:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787864822.638192:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787864822.638332:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787864822.638728:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787864822.638947:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787864822.639102:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787864822.639258:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787864822.639555:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787864822.639692:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787864822.639914:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787864822.640047:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787864822.640195:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787864822.640328:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787864822.640629:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787864822.640858:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787864822.641043:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787864822.641190:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787864822.641337:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787864822.641516:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787864822.641708:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787864822.659002:0:5884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787864822.707713:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787864822.707747:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb035c1c7b988 00100000:10000000:2.0:1787864822.707767:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787864822.708080:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787864822.708096:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787864822.708117:0:5830:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787864822.708142:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787864822.746258:0:5884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787864822.746324:0:5884:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787864822.746328:0:5884:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787864822.844308:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864823.868617:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864824.896117:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864825.915516:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864826.278797:0:6127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787864826.941792:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864827.899736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787864827.899746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787864827.899748:0:8:0:(import.c:65:import_set_state_nolock()) 00000000756bcf63 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787864827.899760:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000756bcf63 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787864827.899770:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb807225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086973568:0@lo:400: 00000100:00100000:3.0:1787864827.899780:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005315bc27 x1874712086973696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864827.900312:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005315bc27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712086973696:0@lo:38: 00000100:00100000:0.0:1787864827.900356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864827.900421:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864827.900520:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973696 00000100:00100000:0.0:1787864827.900526:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973696 00000100:00100000:1.0:1787864827.900560:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973568 00000100:00100000:1.0:1787864827.900565:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973568 00000100:00100000:0.0:1787864827.900567:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864827.900575:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6ff228 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874712086973696:12345-0@lo:38: 00010000:00080000:0.0:1787864827.900600:0:5851:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000100:00100000:1.0:1787864827.900607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864827.900616:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033e5b72a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3317:x1874712086973568:12345-0@lo:400: 00000020:00000080:0.0:1787864827.900644:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa63eebe186191720 00000100:00100000:1.0:1787864827.900748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033e5b72a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3317:x1874712086973568:12345-0@lo:400: Request processed in 133us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864827.900755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787864827.900989:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb807225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086973568:0@lo:400: 00000004:00100000:0.0:1787864827.902376:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864827.902537:0:5851:0:(import.c:65:import_set_state_nolock()) 00000000ab683abe : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864827.902617:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6ff228 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874712086973696:12345-0@lo:38: Request processed in 2040us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.902627:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787864827.903168:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005315bc27 x1874712086973696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787864827.903185:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787864827.903193:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787864827.903197:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787864827.903200:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000756bcf63 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787864827.903205:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005315bc27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712086973696:0@lo:38: 00010000:00010000:3.0:1787864827.963559:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864828.989506:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864830.012147:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864830.461566:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787864830.461573:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2100e4000 from 3 10000000:01000000:0.0:1787864830.461577:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787864830.461618:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864830.461630:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864830.461639:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864830.461660:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e6529c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086973824:0@lo:101: 00000100:00100000:0.0:1787864830.461719:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864830.461898:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f70b043 going to sleep for 11 seconds 00000100:00100000:2.0:1787864830.467326:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973824 00000100:00100000:2.0:1787864830.467340:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973824 00000100:00100000:2.0:1787864830.467545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864830.467555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011dfc92d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5846:x1874712086973824:12345-0@lo:101: 00010000:00010000:2.0:1787864830.467572:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864830.467589:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007e65e829/0xa63eebe18619172e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191727 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.467615:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007e65e829/0xa63eebe18619172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.467626:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007e65e829/0xa63eebe18619172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.467633:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007e65e829, rc 0) 00000100:00100000:2.0:1787864830.467751:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011dfc92d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086973824:12345-0@lo:101: Request processed in 198us (6032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864830.467759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864830.467910:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e6529c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086973824:0@lo:101: 00010000:00010000:1.0:1787864830.467927:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.467943:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864830.468110:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b483c8e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086973952:0@lo:256: 00000100:00100000:0.0:1787864830.468147:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864830.468183:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b559c54 going to sleep for 11 seconds 00000100:00100000:1.0:1787864830.468227:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086973952 00000100:00100000:1.0:1787864830.468233:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086973952 00000100:00100000:1.0:1787864830.468268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864830.468275:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a0c733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086973952:12345-0@lo:256: 20000000:01000000:1.0:1787864830.468289:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864830.468307:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864830.468310:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787864830.468424:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a0c733 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086973952:12345-0@lo:256: Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864830.468544:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b483c8e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086973952:0@lo:256: 10000000:01000000:0.0:1787864830.468584:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864830.468590:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864830.468607:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000afe92715/0xa63eebe186191727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864830.468809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:3.0:1787864830.570040:0:6328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca4a2fc80 20000000:00000080:3.0:1787864830.570061:0:6328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2035b5800 uarg=0000000000000000 20000000:01000000:3.0:1787864830.570095:0:6328:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787864830.570103:0:6328:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787864830.570115:0:6328:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787864830.570366:0:6328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787864830.570394:0:6328:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787864830.575279:0:6328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864830.575682:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787864830.575753:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787864830.575807:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787864830.575829:0:6328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864830.575854:0:6328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.575878:0:6328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916ef expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.575887:0:6328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.575939:0:6328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.575958:0:6328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 11 pid: 5841 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864830.575973:0:6328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005315bc27 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6328:1874712086974080:0@lo:104: 00000100:00100000:3.0:1787864830.576055:0:6328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864830.576128:0:6328:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a2e2208 going to sleep for 11 seconds 00000100:00100000:2.0:1787864830.576153:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974080 00000100:00100000:2.0:1787864830.576166:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974080 00000100:00100000:2.0:1787864830.576224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864830.576233:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb807225 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:6328:x1874712086974080:12345-0@lo:104: 00010000:00010000:2.0:1787864830.576249:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.576353:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864830.576359:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb807225 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:6328:x1874712086974080:12345-0@lo:104: Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864830.576366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864830.576481:0:6328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005315bc27 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6328:1874712086974080:0@lo:104: 00010000:00010000:3.0:1787864830.576506:0:6328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576654:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864830.576660:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576669:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6f1b320 already unused, calling callback (00000000add81c8d) 10000000:00010000:1.0:1787864830.576672:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576680:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864830.576686:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864830.576692:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864830.576790:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576797:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864830.576826:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576833:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe1861916ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861916f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864830.576850:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864830.576852:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864830.576854:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864830.576873:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6399570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086974208:0@lo:103: 00000100:00100000:3.0:1787864830.576932:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864830.577129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974208 00000100:00100000:2.0:1787864830.577136:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974208 00010000:00010000:2.0:1787864830.577161:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 12 pid: 5841 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864830.577199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864830.577209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005315bc27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:3318:x1874712086974208:12345-0@lo:103: 00010000:00010000:2.0:1787864830.577221:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864830.577226:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 12 pid: 5841 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577237:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 12 pid: 5841 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577249:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e2878b15/0xa63eebe1861916f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861916ef expref: 12 pid: 5841 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577263:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577270:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577284:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577290:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577296:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577312:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577317:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d030e90c already unused, calling callback (0000000036c68305) 00010000:00010000:2.0:1787864830.577320:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577327:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577345:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864830.577355:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864830.577459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005315bc27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3318:x1874712086974208:12345-0@lo:103: Request processed in 253us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864830.577539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787864830.577588:0:6328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.577609:0:6328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864830.577617:0:6328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d030e90c/0xa63eebe186191735 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864830.577639:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6399570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086974208:0@lo:103: 00010000:00010000:3.0:1787864831.036165:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864832.059646:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864833.019687:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7356a5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086974464:0@lo:400: 00000100:00100000:2.0:1787864833.019768:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864833.019821:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864833.019828:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e742d686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086974336:0@lo:400: 00000100:00100000:2.0:1787864833.019855:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864833.019922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974464 00000100:00100000:0.0:1787864833.019929:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974464 00000100:00100000:0.0:1787864833.019971:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864833.019979:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a191f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086974464:12345-0@lo:400: 00000100:00100000:0.0:1787864833.020038:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a191f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086974464:12345-0@lo:400: Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864833.020045:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864833.020066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974336 00000100:00100000:0.0:1787864833.020069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974336 00000100:00100000:0.0:1787864833.020091:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787864833.020097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000971dedc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3316:x1874712086974336:12345-0@lo:400: 00000100:00100000:0.0:1787864833.020127:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000971dedc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3316:x1874712086974336:12345-0@lo:400: Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864833.020134:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787864833.020811:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e742d686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086974336:0@lo:400: 00010000:00080000:2.0:1787864833.020826:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e7356a5f x1874712086974464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864833.020836:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7356a5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086974464:0@lo:400: 00010000:00010000:3.0:1787864833.084543:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864834.112528:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864835.133926:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864836.157943:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864836.335231:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787864836.335240:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787864836.335555:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b30cb456 00000020:01000004:2.0:1787864836.335571:0:6692:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787864836.335582:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787864836.335593:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000a053534c) 00000020:00000080:2.0:1787864836.335606:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787864836.358583:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787864836.359045:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787864836.388151:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787864836.394672:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787864836.394704:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787864836.394759:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787864836.394784:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787864836.395749:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787864836.395759:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787864836.395768:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa63eebe186191743 00000020:01000004:3.0:1787864836.395775:0:6692:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787864836.395844:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787864836.395848:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787864836.395854:0:6692:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787864836.395859:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787864836.395869:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000086ba08ec) 00000020:00000080:3.0:1787864836.395878:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787864836.397172:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864836.397885:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787864836.397901:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787864836.399968:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787864836.399982:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787864836.401881:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787864836.401894:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787864836.413768:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864836.414994:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864836.415003:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787864836.416080:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864836.416089:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787864836.446065:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864836.446813:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787864836.446821:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787864836.449769:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787864836.449784:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787864836.453029:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787864836.453045:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787864836.458610:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864836.459000:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864836.459006:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787864836.460151:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864836.460161:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787864836.531078:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864836.531393:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787864836.531549:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787864836.532929:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787864836.532939:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787864836.533393:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787864836.533522:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787864836.533527:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787864836.560300:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787864836.560334:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787864836.560338:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787864836.560340:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787864836.560341:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864836.560357:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864836.560358:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864836.560359:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864836.560360:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864836.560361:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864836.560363:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864836.560364:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864836.560365:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864836.560368:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787864836.560370:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864836.560371:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787864836.560372:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864836.560373:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864836.560374:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864836.560375:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864836.560376:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864836.560376:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864836.560377:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864836.560378:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864836.560379:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864836.560588:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787864836.560606:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d60ba0b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086974592:0@lo:253: 00000100:00100000:0.0:1787864836.560667:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.560816:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c4cf36c going to sleep for 11 seconds 00000100:00100000:2.0:1787864836.560904:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974592 00000100:00100000:2.0:1787864836.560912:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974592 00000100:00100000:2.0:1787864836.560987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864836.560995:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000827b8bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086974592:12345-0@lo:253: 20000000:01000000:2.0:1787864836.561024:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787864836.561028:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787864836.561033:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787864836.561036:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787864836.562121:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864836.562613:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787864836.562627:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787864836.562665:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787864836.562673:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787864836.562713:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787864836.562772:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787864836.563061:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787864836.563081:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:2.0:1787864836.563083:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787864836.563112:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787864836.563119:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787864836.563159:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787864836.563167:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:2.0:1787864836.563195:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787864836.563203:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787864836.563246:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787864836.563294:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787864836.563977:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787864836.563994:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:2.0:1787864836.563995:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787864836.564027:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787864836.564034:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787864836.564062:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787864836.564068:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:2.0:1787864836.564111:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787864836.564119:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787864836.564554:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787864836.564799:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787864836.564819:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787864836.564822:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787864836.564827:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787864836.564828:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787864836.564830:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787864836.564841:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787864836.564843:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787864836.564875:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787864836.564877:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864836.568320:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864836.568646:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864836.568793:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787864836.569131:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787864836.569173:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787864836.569279:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787864836.569294:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787864836.569296:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864836.570157:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864836.570282:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864836.570373:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787864836.570901:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787864836.570936:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787864836.570989:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787864836.571001:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787864836.571004:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787864836.571866:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787864836.572110:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787864836.572148:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787864836.572278:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1787864836.572295:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864836.572313:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572331:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191671 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572368:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619168d expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572374:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861916fd expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572380:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572665:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572745:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 11 pid: 5842 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.572760:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7589b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974720:0@lo:104: 00000100:00100000:3.0:1787864836.572822:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864836.572934:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.572941:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 11 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.572948:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974848:0@lo:104: 00000100:00100000:3.0:1787864836.572968:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864836.573043:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.573051:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 11 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.573066:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974976:0@lo:104: 00000100:00100000:3.0:1787864836.573088:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.573152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974720 00000100:00100000:2.0:1787864836.573159:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974720 00000100:00100000:2.0:1787864836.573195:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974848 00000100:00100000:2.0:1787864836.573204:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974848 00000100:00100000:2.0:1787864836.574234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864836.574242:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016a79b77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:5841:x1874712086974720:12345-0@lo:104: 00010000:00010000:2.0:1787864836.574255:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.574330:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864836.574335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016a79b77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:5841:x1874712086974720:12345-0@lo:104: Request processed in 95us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.574341:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864836.574368:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864836.574374:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e8195a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5841:x1874712086974848:12345-0@lo:104: 00010000:00010000:2.0:1787864836.574380:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574574:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864836.574579:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574587:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000679776c0 already unused, calling callback (00000000add81c8d) 10000000:00010000:1.0:1787864836.574590:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574598:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864836.574605:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864836.574621:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864836.574655:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574661:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864836.574675:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574692:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000679776c0/0xa63eebe1861916fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574706:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864836.574708:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864836.574709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864836.574728:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086975104:0@lo:103: 00000100:00100000:1.0:1787864836.574763:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.574813:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975104 00000100:00100000:1.0:1787864836.574819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975104 00010000:00010000:1.0:1787864836.574839:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 12 pid: 5842 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.574867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864836.574872:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bcf97b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:3317:x1874712086975104:12345-0@lo:103: 00010000:00010000:1.0:1787864836.574885:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864836.574889:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 12 pid: 5842 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574897:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 12 pid: 5842 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.574919:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864836.574941:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bcf97b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:3317:x1874712086975104:12345-0@lo:103: Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.574947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864836.574974:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086975104:0@lo:103: 00010000:00010000:2.0:1787864836.575128:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864836.575133:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e8195a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5841:x1874712086974848:12345-0@lo:104: Request processed in 760us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.575138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864836.575251:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ff97660 going to sleep for 11 seconds 00010000:00010000:3.0:1787864836.575263:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000135a931b/0xa63eebe186191704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861916fd expref: 11 pid: 5842 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.575273:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7589b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974720:0@lo:104: 00000100:00100000:3.0:1787864836.575281:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000419d20f1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974848:0@lo:104: 00000100:00100000:2.0:1787864836.575424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086974976 00000100:00100000:2.0:1787864836.575434:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086974976 00000100:00100000:2.0:1787864836.575452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787864836.575456:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff3f62b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5841:x1874712086974976:12345-0@lo:104: 00010000:00010000:2.0:1787864836.575463:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.575491:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864836.575495:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff3f62b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5841:x1874712086974976:12345-0@lo:104: Request processed in 39us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.575506:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787864836.575980:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864836.575986:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.575994:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d318512 already unused, calling callback (00000000add81c8d) 10000000:00010000:1.0:1787864836.575996:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577627:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864836.577635:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864836.577641:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864836.577726:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577733:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864836.577752:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577759:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000008d318512/0xa63eebe18619168d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191694 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577792:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864836.577795:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577802:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006faca205 already unused, calling callback (00000000add81c8d) 10000000:00010000:1.0:1787864836.577804:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577810:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864836.577815:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864836.577820:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864836.577906:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577913:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864836.577927:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577932:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000006faca205/0xa63eebe186191671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191678 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.577944:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864836.577946:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864836.577948:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864836.577968:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086975360:0@lo:103: 00000100:00100000:3.0:1787864836.577979:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874712086974976:0@lo:104: 00010000:00010000:3.0:1787864836.578005:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.578042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.578101:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864836.578109:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086975232:0@lo:103: 00000100:00100000:1.0:1787864836.578129:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864836.578151:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864836.578163:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975360 00000100:00100000:1.0:1787864836.578168:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975360 00010000:00010000:1.0:1787864836.578196:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 11 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.578221:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975232 00000100:00100000:1.0:1787864836.578224:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975232 00010000:00010000:1.0:1787864836.578233:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.578246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864836.578263:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fb7a361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:3315:x1874712086975360:12345-0@lo:103: 00010000:00010000:1.0:1787864836.578275:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864836.578279:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578287:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578299:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f54b8702/0xa63eebe186191678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191671 expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578313:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864836.578353:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fb7a361 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3315:x1874712086975360:12345-0@lo:103: Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.578369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864836.578387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864836.578392:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7112644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:3317:x1874712086975232:12345-0@lo:103: 00010000:00010000:1.0:1787864836.578420:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864836.578423:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 10 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578432:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 10 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578441:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce9d1306/0xa63eebe186191694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe18619168d expref: 10 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578452:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578459:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578473:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578480:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578485:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578491:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578517:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d030e90c already unused, calling callback (0000000036c68305) 00010000:00010000:1.0:1787864836.578520:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578527:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578537:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.578547:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864836.578574:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7112644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:3317:x1874712086975232:12345-0@lo:103: Request processed in 182us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.578580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864836.578608:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000740393d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086975360:0@lo:103: 00000100:00100000:1.0:1787864836.578629:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086975232:0@lo:103: 00010000:00010000:3.0:1787864836.579302:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.579313:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.579319:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d030e90c/0xa63eebe186191751 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787864836.579332:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787864836.638323:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000827b8bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:6692:x1874712086974592:12345-0@lo:253: Request processed in 77322us (77649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.638338:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864836.638470:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d60ba0b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086974592:0@lo:253: 10000000:01000000:2.0:1787864836.638486:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787864836.638489:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787864836.638490:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787864836.638492:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864836.638493:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787864836.638504:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864836.638505:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864836.638507:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864836.638508:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787864836.638510:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864836.638511:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787864836.638530:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b30cb456 from lustre-OST0000 10000000:01000000:2.0:1787864836.638561:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787864836.638564:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787864836.638570:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa210db4ed8 local copy 10000000:01000000:2.0:1787864836.638574:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787864836.638606:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.638616:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.638625:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.638639:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975488:0@lo:101: 00000100:00100000:2.0:1787864836.638672:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.638718:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000005dc014b3 going to sleep for 11 seconds 00000100:00100000:3.0:1787864836.638981:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975488 00000100:00100000:3.0:1787864836.638987:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975488 00000100:00100000:3.0:1787864836.639034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864836.639056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf0e2453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:6692:x1874712086975488:12345-0@lo:101: 00010000:00010000:3.0:1787864836.639067:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864836.639079:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d030e90c/0xa63eebe18619175f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191758 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.639100:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d030e90c/0xa63eebe18619175f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191758 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.639109:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d030e90c/0xa63eebe18619175f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191758 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.639117:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d030e90c, rc 0) 00000100:00100000:3.0:1787864836.639145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf0e2453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:6692:x1874712086975488:12345-0@lo:101: Request processed in 91us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.639151:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864836.639544:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975488:0@lo:101: 00010000:00010000:2.0:1787864836.639567:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.639574:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.639663:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975616:0@lo:501: 00000100:00100000:2.0:1787864836.639690:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.639720:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000005dc014b3 going to sleep for 11 seconds 00000100:00100000:3.0:1787864836.639825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975616 00000100:00100000:3.0:1787864836.639829:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975616 00000100:00100000:3.0:1787864836.639856:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864836.639863:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fca427ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:6692:x1874712086975616:12345-0@lo:501: 00000100:00100000:3.0:1787864836.640033:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fca427ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:6692:x1874712086975616:12345-0@lo:501: Request processed in 172us (343us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864836.640040:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864836.640288:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975616:0@lo:501: 10000000:01000000:2.0:1787864836.640302:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787864836.640326:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787864836.640331:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640338:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640353:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640376:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787864836.640417:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa23be5b800 10000000:01000000:2.0:1787864836.640422:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787864836.640427:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa210db4ed8 10000000:01000000:2.0:1787864836.640438:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787864836.640441:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa210db4ed8 from 1 10000000:01000000:2.0:1787864836.640443:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787864836.640467:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640486:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640496:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.640511:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975744:0@lo:101: 00000100:00100000:2.0:1787864836.640690:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.640715:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:2.0:1787864836.640730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975744 00000100:00100000:2.0:1787864836.640734:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975744 00000100:00100000:2.0:1787864836.640758:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864836.640765:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c852893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:6692:x1874712086975744:12345-0@lo:101: 00010000:00010000:2.0:1787864836.640774:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864836.640785:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7e1069b/0xa63eebe18619176d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191766 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640867:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7e1069b/0xa63eebe18619176d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191766 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640877:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7e1069b/0xa63eebe18619176d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191766 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640883:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7e1069b, rc 0) 00000100:00100000:2.0:1787864836.640911:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c852893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086975744:12345-0@lo:101: Request processed in 147us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.640917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864836.640946:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975744:0@lo:101: 00010000:00010000:2.0:1787864836.640961:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.640968:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864836.640982:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787864836.640997:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.641005:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 0000000022e1e5ab/0xa63eebe186191766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864836.641011:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787864836.641014:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864836.641018:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787864836.641020:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787864836.641032:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.641038:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.641044:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.641054:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975872:0@lo:101: 00000100:00100000:2.0:1787864836.641078:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.641093:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.641100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086975872 00000100:00100000:0.0:1787864836.641105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086975872 00000100:00100000:0.0:1787864836.641132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864836.641137:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000920a6d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086975872:12345-0@lo:101: 00010000:00010000:0.0:1787864836.641144:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864836.641156:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce9d1306/0xa63eebe18619177b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191774 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.641169:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce9d1306/0xa63eebe18619177b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191774 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.641176:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce9d1306/0xa63eebe18619177b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191774 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.641181:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce9d1306, rc 0) 00000100:00100000:0.0:1787864836.641211:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000920a6d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086975872:12345-0@lo:101: Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.641217:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787864836.641830:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864836.641837:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.641846:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6f1b320 already unused, calling callback (00000000add81c8d) 10000000:00010000:3.0:1787864836.641849:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.641869:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864836.641876:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864836.641881:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864836.641901:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.641906:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864836.641933:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.641939:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000c6f1b320/0xa63eebe186191758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe18619175f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.641952:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864836.641954:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864836.641955:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864836.642104:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864836.642117:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086976000:0@lo:103: 00000100:00100000:0.0:1787864836.642156:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864836.642357:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976000 00000100:00100000:3.0:1787864836.642363:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976000 00000100:00100000:3.0:1787864836.642469:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864836.642478:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e70cb5ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:3315:x1874712086976000:12345-0@lo:103: 00010000:00010000:3.0:1787864836.642488:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864836.642500:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d030e90c/0xa63eebe18619175f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191758 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.642511:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864836.642553:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e70cb5ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:3315:x1874712086976000:12345-0@lo:103: Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.642560:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864836.642752:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086976000:0@lo:103: 00000100:00100000:2.0:1787864836.642844:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086975872:0@lo:101: 00010000:00010000:2.0:1787864836.642866:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.642875:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.642976:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976128:0@lo:501: 00000100:00100000:2.0:1787864836.643137:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.643211:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.643312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976128 00000100:00100000:0.0:1787864836.643318:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976128 00000100:00100000:0.0:1787864836.643364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864836.643371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063c2d7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976128:12345-0@lo:501: 00000100:00100000:0.0:1787864836.643821:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063c2d7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976128:12345-0@lo:501: Request processed in 451us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.643828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864836.643888:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976128:0@lo:501: 00000100:00100000:2.0:1787864836.643920:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976256:0@lo:503: 00000100:00100000:2.0:1787864836.643959:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.644104:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.644140:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976256 00000100:00100000:0.0:1787864836.644144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976256 00000100:00100000:0.0:1787864836.644201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864836.644208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0093763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976256:12345-0@lo:503: 00000100:00100000:0.0:1787864836.644379:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0093763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976256:12345-0@lo:503: Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.644393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864836.644478:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976256:0@lo:503: 00000040:00080000:2.0:1787864836.644735:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864836.644801:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976384:0@lo:502: 00000100:00100000:2.0:1787864836.644836:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.645780:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:3.0:1787864836.645896:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976384 00000100:00100000:3.0:1787864836.645903:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976384 00000100:00100000:3.0:1787864836.645935:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864836.645942:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec311688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976384:12345-0@lo:502: 00000100:00100000:3.0:1787864836.646143:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec311688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976384:12345-0@lo:502: Request processed in 201us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.646151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787864836.646298:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976384:0@lo:502: 00000040:00080000:2.0:1787864836.646598:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787864836.646647:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787864836.646690:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787864836.646736:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787864836.646769:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787864836.646799:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787864836.646827:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976512:0@lo:502: 00000100:00100000:2.0:1787864836.646876:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.646896:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064df7a90 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.647119:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976512 00000100:00100000:0.0:1787864836.647125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976512 00000100:00100000:2.0:1787864836.647387:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787864836.647421:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6c6ded3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976512:12345-0@lo:502: 00000100:00100000:2.0:1787864836.647599:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6c6ded3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976512:12345-0@lo:502: Request processed in 205us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.647606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864836.647711:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a555833 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976512:0@lo:502: 00000040:00080000:0.0:1787864836.647820:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787864836.647831:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787864836.648526:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787864836.648534:0:6710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787864836.648540:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864836.648543:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787864836.648547:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864836.648560:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000036b1a8ce) 00000020:00000080:0.0:1787864836.648581:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787864836.648586:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787864836.648659:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b30cb456 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787864836.648668:0:6710:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787864836.652379:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa63eebe186191789 00010000:00010000:0.0:1787864836.656876:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787864836.657195:0:6710:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787864836.662242:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787864836.663060:0:6710:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787864836.676231:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787864836.678441:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787864836.681909:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787864836.681920:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864836.681927:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864836.681929:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787864836.681932:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864836.681936:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864836.681937:0:6710:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787864836.681940:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787864836.681948:0:6710:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787864836.681990:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864836.681994:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864836.681995:0:6710:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787864836.681998:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787864836.691640:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787864836.691680:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787864836.691698:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.691710:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000009b9931f6/0xa63eebe186191774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864836.692440:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23be5b800 from 1 10000000:01000000:0.0:1787864836.692445:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864836.692483:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000f54b8702/0xa63eebe186191790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.692492:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000f54b8702/0xa63eebe186191790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.692512:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000f54b8702/0xa63eebe186191790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864836.692535:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a48e2db9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976640:0@lo:101: 00000100:00100000:0.0:1787864836.692608:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.692647:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1d8171f going to sleep for 11 seconds 00000100:00100000:3.0:1787864836.693709:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976640 00000100:00100000:3.0:1787864836.693720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976640 00000100:00100000:3.0:1787864836.693774:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864836.693783:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000611a44bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+10:6692:x1874712086976640:12345-0@lo:101: 00010000:00010000:3.0:1787864836.693798:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864836.693812:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d030e90c/0xa63eebe186191797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191790 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.693835:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d030e90c/0xa63eebe186191797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191790 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.693853:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d030e90c/0xa63eebe186191797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191790 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.693861:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d030e90c, rc 0) 00000100:00100000:3.0:1787864836.693919:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000611a44bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086976640:12345-0@lo:101: Request processed in 138us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.693926:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864836.694390:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a48e2db9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976640:0@lo:101: 00010000:00010000:0.0:1787864836.694667:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000f54b8702/0xa63eebe186191790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.694677:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000f54b8702/0xa63eebe186191790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.694867:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976768:0@lo:501: 00000100:00100000:3.0:1787864836.694910:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864836.694945:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000256ae3b6 going to sleep for 11 seconds 00000100:00100000:2.0:1787864836.696668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976768 00000100:00100000:2.0:1787864836.696731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976768 00000100:00100000:2.0:1787864836.696824:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864836.696834:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d465bc5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086976768:12345-0@lo:501: 00000100:00100000:2.0:1787864836.697104:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d465bc5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086976768:12345-0@lo:501: Request processed in 271us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.697112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864836.697187:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3abb8a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976768:0@lo:501: 00000100:00100000:1.0:1787864836.697229:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976896:0@lo:503: 00000100:00100000:1.0:1787864836.697282:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.698436:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b8623ff going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.698654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086976896 00000100:00100000:0.0:1787864836.698660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086976896 00000100:00100000:0.0:1787864836.698703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787864836.698711:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021e20af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086976896:12345-0@lo:503: 00000100:00100000:0.0:1787864836.699189:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021e20af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086976896:12345-0@lo:503: Request processed in 478us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.699197:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787864836.699368:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086976896:0@lo:503: 00000040:00080000:1.0:1787864836.699689:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864836.699761:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977024:0@lo:502: 00000100:00100000:1.0:1787864836.699802:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.699829:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2302b92 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.699936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977024 00000100:00100000:0.0:1787864836.699941:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977024 00000100:00100000:0.0:1787864836.699964:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787864836.699970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011e0e0b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086977024:12345-0@lo:502: 00000100:00100000:0.0:1787864836.700125:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011e0e0b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086977024:12345-0@lo:502: Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.700132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864836.700500:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977024:0@lo:502: 00000040:00080000:1.0:1787864836.700829:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787864836.700882:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787864836.700907:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977152:0@lo:502: 00000100:00100000:1.0:1787864836.700950:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.700983:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2302b92 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.701037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977152 00000100:00100000:0.0:1787864836.701043:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977152 00000100:00100000:0.0:1787864836.701074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787864836.701082:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002753e3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086977152:12345-0@lo:502: 00000100:00100000:0.0:1787864836.701231:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002753e3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086977152:12345-0@lo:502: Request processed in 149us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.701238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864836.701550:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb35ea5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977152:0@lo:502: 00000040:00080000:1.0:1787864836.701639:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787864836.701648:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787864836.703323:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864836.703334:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864836.703337:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787864836.703356:0:6714:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa23be5b800 00000020:00000080:2.0:1787864836.703358:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864836.703426:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864836.703579:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864836.703581:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787864836.703585:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787864836.703809:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787864836.703831:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864836.703852:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.703880:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864836.703917:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787864836.703921:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa23be5b800 10000000:01000000:1.0:1787864836.703924:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa23be5b800 10000000:01000000:1.0:1787864836.703928:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864836.703933:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa23be5b800 from 1 10000000:01000000:1.0:1787864836.703935:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787864836.703968:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.703976:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.703987:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.704135:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977280:0@lo:101: 00000100:00100000:1.0:1787864836.704201:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.704676:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864836.705090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977280 00000100:00100000:2.0:1787864836.705097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977280 00000100:00100000:2.0:1787864836.705186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787864836.705196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086977280:12345-0@lo:101: 00010000:00010000:2.0:1787864836.705210:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864836.705238:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619179e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.705266:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619179e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.705278:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619179e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.705286:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850000, rc 0) 00000100:00100000:2.0:1787864836.705341:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977280:12345-0@lo:101: Request processed in 147us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.705356:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864836.705457:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977280:0@lo:101: 00010000:00010000:1.0:1787864836.705472:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.705481:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864836.705603:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977408:0@lo:501: 00000100:00100000:1.0:1787864836.705632:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.705903:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.705957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977408 00000100:00100000:0.0:1787864836.705962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977408 00000100:00100000:0.0:1787864836.705984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864836.705991:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977408:12345-0@lo:501: 00000100:00100000:0.0:1787864836.706252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977408:12345-0@lo:501: Request processed in 260us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.706259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787864836.707952:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977408:0@lo:501: 00000100:00100000:1.0:1787864836.708015:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977536:0@lo:503: 00000100:00100000:1.0:1787864836.708073:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.708098:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.708150:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977536 00000100:00100000:0.0:1787864836.708155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977536 00000100:00100000:0.0:1787864836.708201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864836.708210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977536:12345-0@lo:503: 00000100:00100000:0.0:1787864836.708414:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977536:12345-0@lo:503: Request processed in 185us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.708422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864836.708647:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977536:0@lo:503: 00000040:00080000:3.0:1787864836.708922:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864836.708991:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977664:0@lo:502: 00000100:00100000:3.0:1787864836.709042:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864836.709070:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b301a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864836.709199:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977664 00000100:00100000:0.0:1787864836.709204:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977664 00000100:00100000:0.0:1787864836.709236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864836.709245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977664:12345-0@lo:502: 00000100:00100000:0.0:1787864836.709547:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977664:12345-0@lo:502: Request processed in 303us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.709554:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864836.709597:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977664:0@lo:502: 00000040:00080000:0.0:1787864836.709827:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787864836.709885:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787864836.709921:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787864836.709980:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787864836.710137:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787864836.710188:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787864836.710224:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787864836.710257:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787864836.710315:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787864836.710366:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787864836.710569:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787864836.710629:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787864836.710679:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787864836.710714:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787864836.710760:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787864836.710798:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787864836.710832:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787864836.710879:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787864836.710917:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787864836.710952:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787864836.711000:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787864836.711036:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787864836.711067:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787864836.711127:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787864836.711163:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787864836.711195:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787864836.711239:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787864836.711274:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787864836.711318:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977792:0@lo:502: 00000100:00100000:0.0:1787864836.711390:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.711626:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864836.712817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977792 00000100:00100000:1.0:1787864836.712828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977792 00000100:00100000:1.0:1787864836.712914:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787864836.712924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977792:12345-0@lo:502: 00000100:00100000:1.0:1787864836.713177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086977792:12345-0@lo:502: Request processed in 254us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.713184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787864836.713266:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086977792:0@lo:502: 00000040:00080000:2.0:1787864836.713380:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787864836.713415:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787864836.714638:0:6715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787864836.714653:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa22f9a1a48) 00000020:00000080:1.0:1787864836.714672:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787864836.714825:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa23be5b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787864836.714829:0:6715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa23be5b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787864836.714832:0:6715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa23be5b800 3 00010000:00080000:1.0:1787864836.714860:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa105679800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787864836.717245:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787864836.717546:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787864836.717582:0:6715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787864836.717595:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa63eebe1861917b3 00000100:00080000:1.0:1787864836.717605:0:6715:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864836.717617:0:6715:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa105679800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787864836.717650:0:6715:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20cb5fc00 x1874712086977920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864836.717744:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787864836.717888:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712086977920:0@lo:38: 00000100:00100000:0.0:1787864836.717960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.718176:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712086978048:0@lo:400: 00000100:00100000:0.0:1787864836.718204:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.718236:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086977920 00000100:00100000:0.0:1787864836.718241:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086977920 00000100:00100000:0.0:1787864836.718271:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978048 00000100:00100000:0.0:1787864836.718273:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978048 00000100:00100000:0.0:1787864836.718296:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864836.718304:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712086978048:12345-0@lo:400: 00000100:00100000:0.0:1787864836.718364:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712086978048:12345-0@lo:400: Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.718371:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864836.718386:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864836.718391:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1874712086977920:12345-0@lo:38: 00010000:00080000:0.0:1787864836.718491:0:5849:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:0.0:1787864836.718531:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa63eebe1861917ba 00000004:00100000:0.0:1787864836.718547:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864836.718580:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9fa23b1d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864836.718617:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874712086977920:12345-0@lo:38: Request processed in 224us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864836.718623:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787864836.718657:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa20c0c6580 x1874712086978048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864836.718669:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712086978048:0@lo:400: 00010000:00080000:0.0:1787864836.718777:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa20cb5fc00 x1874712086977920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864836.718785:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864836.718798:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787864836.718805:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787864836.718809:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787864836.718812:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa105679800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864836.718818:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712086977920:0@lo:38: 00000040:00080000:2.0:1787864836.723877:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787864836.724117:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787864836.724141:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864836.724162:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.724173:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787864836.724223:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787864836.724225:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864836.724226:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864836.724228:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864836.724233:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864836.724234:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864836.724237:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864836.724238:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864836.724240:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864836.724241:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864836.724242:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864836.724245:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787864836.724247:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864836.724248:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864836.724249:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864836.724250:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864836.724251:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864836.724252:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864836.724253:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864836.724254:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864836.724255:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864836.724256:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864836.724257:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864836.724279:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787864836.724295:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086978176:0@lo:253: 00000100:00100000:3.0:1787864836.724367:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.724573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978176 00000100:00100000:2.0:1787864836.724579:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978176 00000100:00100000:2.0:1787864836.724625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787864836.724634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6692:x1874712086978176:12345-0@lo:253: 20000000:01000000:2.0:1787864836.724658:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787864836.724671:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787864836.725289:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b301300 going to sleep for 11 seconds 20000000:01000000:2.0:1787864836.756914:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787864836.756934:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787864836.757020:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787864836.757025:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787864836.757045:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.757062:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.757069:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.757103:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.757133:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.757146:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086978304:0@lo:104: 00000100:00100000:3.0:1787864836.757204:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864836.757251:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864836.757336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978304 00000100:00100000:2.0:1787864836.757352:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978304 00000100:00100000:2.0:1787864836.757417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864836.757436:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086978304:12345-0@lo:104: 00010000:00010000:2.0:1787864836.757457:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757507:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864836.757512:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086978304:12345-0@lo:104: Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.757519:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787864836.757540:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864836.757545:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757553:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787864836.757557:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757564:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864836.757571:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864836.757577:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864836.757604:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757611:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864836.757626:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757632:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe186191727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619172e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757654:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864836.757656:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864836.757657:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864836.757674:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086978432:0@lo:103: 00000100:00100000:2.0:1787864836.757717:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.757749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978432 00000100:00100000:2.0:1787864836.757753:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978432 00010000:00010000:2.0:1787864836.757768:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 13 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.757788:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864836.757794:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3318:x1874712086978432:12345-0@lo:103: 00010000:00010000:2.0:1787864836.757803:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864836.757807:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 13 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757817:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 13 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757831:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757838:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864836.757848:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001210832s 00010000:00010000:2.0:1787864836.757852:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757878:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757884:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757890:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757896:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242142600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864836.757899:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757906:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757915:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.757923:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864836.757950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3318:x1874712086978432:12345-0@lo:103: Request processed in 156us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.757957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864836.758013:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086978432:0@lo:103: 00010000:00010000:2.0:1787864836.758039:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850c00/0xa63eebe18619172e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191727 expref: 12 pid: 5841 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864836.758048:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086978304:0@lo:104: 00010000:00010000:2.0:1787864836.758058:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.758071:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.758077:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864836.758083:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242142600/0xa63eebe1861917c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864836.763890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:6692:x1874712086978176:12345-0@lo:253: Request processed in 39249us (39515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864836.763906:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787864836.764330:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:6692:1874712086978176:0@lo:253: 10000000:01000000:2.0:1787864836.764355:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787864836.764358:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787864836.764360:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787864836.764361:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864836.764362:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864836.764364:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864836.764365:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864836.764366:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864836.764368:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864836.764369:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864836.764371:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864836.764372:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787864836.764384:0:6692:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787864836.771089:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787864836.771278:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787864836.771632:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787864836.771789:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787864836.772056:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787864836.772209:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787864836.775231:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787864837.007106:0:6692:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787864837.007114:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787864837.007232:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787864837.007290:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787864837.007305:0:6692:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787864837.007331:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787864837.180250:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787864837.631783:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787864837.631791:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2100e4000 from 21 10000000:01000000:1.0:1787864837.631796:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787864837.631841:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.631852:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.631863:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864837.631886:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978560:0@lo:101: 00000100:00100000:1.0:1787864837.631950:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.632005:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.632061:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978560 00000100:00100000:1.0:1787864837.632068:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978560 00000100:00100000:1.0:1787864837.632117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787864837.632126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:5846:x1874712086978560:12345-0@lo:101: 00010000:00010000:1.0:1787864837.632151:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864837.632165:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861917c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.632188:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.632218:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.632227:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a000, rc 0) 00000100:00100000:1.0:1787864837.632264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086978560:12345-0@lo:101: Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.632271:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787864837.632314:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978560:0@lo:101: 00010000:00010000:1.0:1787864837.632326:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.632333:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864837.632393:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978688:0@lo:501: 00000100:00100000:1.0:1787864837.632440:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.632458:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.632478:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978688 00000100:00100000:1.0:1787864837.632482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978688 00000100:00100000:1.0:1787864837.632500:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864837.632505:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086978688:12345-0@lo:501: 00000100:00100000:1.0:1787864837.632810:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086978688:12345-0@lo:501: Request processed in 303us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.632817:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864837.632849:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978688:0@lo:501: 00000100:00100000:1.0:1787864837.632875:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978816:0@lo:503: 00000100:00100000:1.0:1787864837.632916:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.632930:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.632942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978816 00000100:00100000:1.0:1787864837.632945:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978816 00000100:00100000:1.0:1787864837.632965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864837.632972:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086978816:12345-0@lo:503: 00000100:00100000:1.0:1787864837.633290:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086978816:12345-0@lo:503: Request processed in 317us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.633297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787864837.633381:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086978816:0@lo:503: 00000100:00100000:0.0:1787864837.634060:0:6743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6743:1874712086978944:0@lo:502: 00000100:00100000:0.0:1787864837.634111:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.634139:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086978944 00000100:00100000:0.0:1787864837.634144:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086978944 00000100:00100000:0.0:1787864837.634176:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864837.634185:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6743:x1874712086978944:12345-0@lo:502: 00000100:00100000:0.0:1787864837.635560:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6743:x1874712086978944:12345-0@lo:502: Request processed in 1370us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864837.635572:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864837.636196:0:6743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864837.636433:0:6743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6743:1874712086978944:0@lo:502: 00000100:00100000:0.0:1787864837.636505:0:6743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6743:1874712086979072:0@lo:502: 00000100:00100000:0.0:1787864837.638612:0:6743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.638910:0:6743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864837.639173:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979072 00000100:00100000:2.0:1787864837.639181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979072 00000100:00100000:2.0:1787864837.639238:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864837.639247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6743:x1874712086979072:12345-0@lo:502: 00000100:00100000:2.0:1787864837.639525:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:6743:x1874712086979072:12345-0@lo:502: Request processed in 279us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.639534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864837.641811:0:6743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6743:1874712086979072:0@lo:502: 00000040:00080000:0.0:1787864837.641871:0:6743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787864837.642421:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787864837.642443:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864837.642453:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.642464:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864837.642474:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864837.642476:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2100e4000 from 4 10000000:01000000:2.0:1787864837.642479:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864837.642512:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.642520:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.642529:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864837.642559:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979200:0@lo:101: 00000100:00100000:2.0:1787864837.642615:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.642650:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2034873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864837.643264:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979200 00000100:00100000:0.0:1787864837.643271:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979200 00000100:00100000:0.0:1787864837.643315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787864837.643331:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086979200:12345-0@lo:101: 00010000:00010000:0.0:1787864837.643354:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864837.643368:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861917d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.643389:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.643413:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.643421:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031a00, rc 0) 00000100:00100000:0.0:1787864837.643464:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086979200:12345-0@lo:101: Request processed in 135us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864837.643470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864837.643615:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979200:0@lo:101: 00010000:00010000:3.0:1787864837.643632:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864837.643641:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864837.643705:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979328:0@lo:256: 00000100:00100000:3.0:1787864837.643737:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864837.643774:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864837.643863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979328 00000100:00100000:0.0:1787864837.643868:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979328 00000100:00100000:0.0:1787864837.643898:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787864837.643904:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086979328:12345-0@lo:256: 20000000:01000000:0.0:1787864837.643916:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787864837.643929:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787864837.643932:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787864837.643999:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086979328:12345-0@lo:256: Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864837.644007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787864837.644038:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979328:0@lo:256: 10000000:01000000:0.0:1787864837.644077:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864837.644083:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.644096:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864837.644103:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787864837.644105:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787864837.644108:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864837.644124:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.644130:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.644138:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864837.644149:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979456:0@lo:101: 00000100:00100000:0.0:1787864837.644182:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.644202:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864837.644421:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979456 00000100:00100000:2.0:1787864837.644426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979456 00000100:00100000:2.0:1787864837.644459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787864837.644466:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086979456:12345-0@lo:101: 00010000:00010000:2.0:1787864837.644474:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864837.644483:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861917e4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.644499:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.644508:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.644515:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850e00, rc 0) 00000100:00100000:2.0:1787864837.644546:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086979456:12345-0@lo:101: Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.644553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787864837.645661:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979456:0@lo:101: 00010000:00010000:0.0:1787864837.645683:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.645693:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864837.645750:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979584:0@lo:501: 00000100:00100000:0.0:1787864837.645799:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.645914:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864837.646762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979584 00000100:00100000:3.0:1787864837.646771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979584 00000100:00100000:3.0:1787864837.646852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864837.646863:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086979584:12345-0@lo:501: 00000100:00100000:3.0:1787864837.647112:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086979584:12345-0@lo:501: Request processed in 250us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864837.647129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787864837.647331:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979584:0@lo:501: 00000100:00100000:0.0:1787864837.647385:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979712:0@lo:503: 00000100:00100000:0.0:1787864837.647448:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.647650:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.647768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979712 00000100:00100000:1.0:1787864837.647774:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979712 00000100:00100000:1.0:1787864837.647800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787864837.647807:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086979712:12345-0@lo:503: 00000100:00100000:1.0:1787864837.648109:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086979712:12345-0@lo:503: Request processed in 301us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.648117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787864837.648239:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086979712:0@lo:503: 00000100:00100000:0.0:1787864837.653872:0:6744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6744:1874712086979840:0@lo:502: 00000100:00100000:0.0:1787864837.653955:0:6744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.654031:0:6744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.656450:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979840 00000100:00100000:1.0:1787864837.656463:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979840 00000100:00100000:1.0:1787864837.656509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864837.656518:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:6744:x1874712086979840:12345-0@lo:502: 00000100:00100000:1.0:1787864837.656970:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:6744:x1874712086979840:12345-0@lo:502: Request processed in 451us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.656978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864837.657077:0:6744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6744:1874712086979840:0@lo:502: 00000020:01000000:3.0:1787864837.657112:0:6744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787864837.657119:0:6744:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787864837.657125:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864837.657128:0:6744:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787864837.657145:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787864837.657149:0:6744:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:3.0:1787864837.657175:0:6744:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787864837.657178:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864837.657206:0:6744:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa205943490) 00000020:00000080:3.0:1787864837.657227:0:6744:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787864837.657233:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787864837.657318:0:6744:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787864837.657324:0:6744:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787864837.657330:0:6744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861917f9 00010000:00080000:3.0:1787864837.657376:0:6744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa22f74e000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:3.0:1787864837.657636:0:6744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787864837.708563:0:6744:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787864837.708584:0:6744:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787864837.709468:0:6744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864837.709673:0:6744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864837.709726:0:6744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787864837.709788:0:6744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787864837.712564:0:6746:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864837.712572:0:6746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787864837.713622:0:6744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787864837.713634:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787864837.713666:0:6744:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787864837.713701:0:6744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186191800 00000100:00080000:2.0:1787864837.713712:0:6744:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864837.713725:0:6744:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa22f74e000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787864837.713761:0:6744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20c1d43c0 x1874712086979968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864837.713787:0:6744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787864837.713843:0:6744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864837.713848:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864837.713850:0:6744:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787864837.713853:0:6744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864837.713857:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864837.713858:0:6744:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787864837.713861:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787864837.713863:0:6744:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787864837.713888:0:6744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6744:1874712086980096:0@lo:502: 00000100:00100000:2.0:1787864837.713962:0:6744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.714012:0:6744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2034873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.714332:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980096 00000100:00100000:1.0:1787864837.714349:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980096 00000100:00100000:1.0:1787864837.714448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787864837.714458:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:6744:x1874712086980096:12345-0@lo:502: 00000100:00100000:1.0:1787864837.714702:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:6744:x1874712086980096:12345-0@lo:502: Request processed in 245us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.714710:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787864837.714789:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086980224:0@lo:400: 00000100:00100000:2.0:1787864837.714820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.714859:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864837.714864:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086980352:0@lo:400: 00000100:00100000:2.0:1787864837.714890:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.714921:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980224 00000100:00100000:2.0:1787864837.714925:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980224 00000100:00100000:2.0:1787864837.714952:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980352 00000100:00100000:2.0:1787864837.714955:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980352 00000100:00100000:2.0:1787864837.714978:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864837.714985:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086980224:12345-0@lo:400: 00000100:00100000:2.0:1787864837.715021:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086980224:12345-0@lo:400: Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.715028:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864837.715048:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864837.715054:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086980352:12345-0@lo:400: 00000100:00100000:2.0:1787864837.715083:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086980352:12345-0@lo:400: Request processed in 29us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.715088:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787864837.715122:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c7c00 x1874712086980352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864837.715147:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086980352:0@lo:400: 00010000:00080000:2.0:1787864837.715160:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c4f00 x1874712086980224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864837.715167:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086980224:0@lo:400: 00000100:00100000:0.0:1787864837.715425:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712086979968:0@lo:8: 00000100:00100000:0.0:1787864837.715460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.715615:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086979968 00000100:00100000:2.0:1787864837.715620:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086979968 00000100:00100000:2.0:1787864837.715691:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864837.715696:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1874712086979968:12345-0@lo:8: 00010000:00080000:2.0:1787864837.715717:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1787864837.715741:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186191807 00002000:00100000:2.0:1787864837.715775:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa23fd35800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787864837.715780:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787864837.715783:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787864837.715889:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787864837.716021:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787864837.716044:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd33800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864837.716088:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874712086979968:12345-0@lo:8: Request processed in 391us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.716104:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787864837.716266:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1d43c0 x1874712086979968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864837.716275:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864837.716281:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787864837.716287:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787864837.716291:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787864837.716293:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f74e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787864837.716315:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787864837.716320:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712086979968:0@lo:8: 00000100:00080000:1.0:1787864837.716505:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864837.716528:0:6744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6744:1874712086980096:0@lo:502: 00000020:01000000:1.0:1787864837.716559:0:6744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864837.716565:0:6744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864837.716567:0:6744:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787864837.716575:0:6744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787864837.717959:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787864837.717985:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787864837.717994:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718005:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864837.718023:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864837.718025:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2100e4000 from 1 10000000:01000000:0.0:1787864837.718027:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864837.718059:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718066:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718076:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864837.718095:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980480:0@lo:101: 00000100:00100000:0.0:1787864837.718219:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.718257:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20587a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864837.718290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980480 00000100:00100000:0.0:1787864837.718296:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980480 00000100:00100000:0.0:1787864837.718335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787864837.718353:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086980480:12345-0@lo:101: 00010000:00010000:0.0:1787864837.718364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864837.718376:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619180e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718419:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619180e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718430:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619180e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718448:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031600, rc 0) 00000100:00100000:0.0:1787864837.718481:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086980480:12345-0@lo:101: Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864837.718487:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787864837.718535:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980480:0@lo:101: 00010000:00010000:0.0:1787864837.718546:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864837.718554:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864837.718592:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980608:0@lo:501: 00000100:00100000:0.0:1787864837.718613:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.718625:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20587a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864837.718771:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980608 00000100:00100000:3.0:1787864837.718775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980608 00000100:00100000:3.0:1787864837.718796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787864837.718802:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086980608:12345-0@lo:501: 00000100:00100000:3.0:1787864837.718995:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086980608:12345-0@lo:501: Request processed in 193us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864837.719009:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787864837.720026:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980608:0@lo:501: 00000100:00100000:0.0:1787864837.720069:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980736:0@lo:503: 00000100:00100000:0.0:1787864837.720117:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864837.720302:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20587a0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787864837.720445:0:6746:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787864837.720580:0:6746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 153660182522ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787864837.727353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980736 00000100:00100000:1.0:1787864837.727365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980736 00000100:00100000:1.0:1787864837.727435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787864837.727444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086980736:12345-0@lo:503: 00000100:00100000:1.0:1787864837.728359:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086980736:12345-0@lo:503: Request processed in 913us (8238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.728370:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787864837.728456:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086980736:0@lo:503: 00000100:00100000:2.0:1787864837.729020:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6750:1874712086980864:0@lo:502: 00000100:00100000:2.0:1787864837.729070:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.729118:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.729220:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980864 00000100:00100000:1.0:1787864837.729225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980864 00000100:00100000:1.0:1787864837.729265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787864837.729274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:6750:x1874712086980864:12345-0@lo:502: 00000100:00100000:1.0:1787864837.729526:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:6750:x1874712086980864:12345-0@lo:502: Request processed in 252us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.729533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787864837.729660:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6750:1874712086980864:0@lo:502: 00000020:01000000:1.0:1787864837.729696:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864837.729708:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864837.729710:0:6750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787864837.729721:0:6750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2100e4000 00000020:00000080:1.0:1787864837.729724:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864837.729745:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6750:1874712086980992:0@lo:502: 00000100:00100000:1.0:1787864837.729786:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.732979:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864837.734517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086980992 00000100:00100000:2.0:1787864837.734529:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086980992 00000100:00100000:2.0:1787864837.734631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864837.734642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:6750:x1874712086980992:12345-0@lo:502: 00000100:00100000:2.0:1787864837.734981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:6750:x1874712086980992:12345-0@lo:502: Request processed in 340us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.734990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787864837.735247:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:6750:1874712086980992:0@lo:502: 00000020:01000000:0.0:1787864837.735282:0:6750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864837.735289:0:6750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864837.735292:0:6750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787864837.735298:0:6750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787864837.736095:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787864837.736120:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864837.736142:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736155:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864837.736168:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787864837.736171:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa210db4ed8 from 1 10000000:01000000:1.0:1787864837.736174:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787864837.736207:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736215:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736224:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864837.736242:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086981120:0@lo:101: 00000100:00100000:1.0:1787864837.736298:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.736351:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.736369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981120 00000100:00100000:1.0:1787864837.736381:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981120 00000100:00100000:1.0:1787864837.736439:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864837.736449:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086981120:12345-0@lo:101: 00010000:00010000:1.0:1787864837.736460:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864837.736472:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619181c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736501:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736509:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b000, rc 0) 00000100:00100000:1.0:1787864837.736538:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086981120:12345-0@lo:101: Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.736544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864837.736575:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086981120:0@lo:101: 00010000:00010000:1.0:1787864837.736586:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864837.736594:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864837.736639:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086981248:0@lo:501: 00000100:00100000:1.0:1787864837.736662:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864837.736876:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.736888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981248 00000100:00100000:1.0:1787864837.736891:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981248 00000100:00100000:1.0:1787864837.736914:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787864837.736920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086981248:12345-0@lo:501: 00000100:00100000:1.0:1787864837.737121:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086981248:12345-0@lo:501: Request processed in 199us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864837.737135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787864837.737254:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086981248:0@lo:501: 10000000:01000000:2.0:1787864837.737277:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787864837.737283:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864837.737291:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864837.790371:0:6747:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787864837.790427:0:6747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981504:0@lo:7: 00000100:00100000:2.0:1787864837.790497:0:6747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.790549:0:6747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864837.790587:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086981376:0@lo:13: 00000100:00100000:2.0:1787864837.790614:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864837.790651:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981504 00000100:00100000:2.0:1787864837.790664:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981504 00000100:00100000:2.0:1787864837.790721:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864837.790729:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6747:x1874712086981504:12345-0@lo:7: 00000100:00080000:1.0:1787864837.791250:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787864837.797078:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787864837.797085:0:6696:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787864837.797292:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6747:x1874712086981504:12345-0@lo:7: Request processed in 6559us (6790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.797303:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864837.797355:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981376 00000100:00100000:2.0:1787864837.797362:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981376 00000100:00100000:2.0:1787864837.797443:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864837.797452:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086981376:12345-0@lo:13: 00002000:00000024:2.0:1787864837.797473:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1787864837.797510:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086981376:12345-0@lo:13: Request processed in 59us (6895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864837.797516:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787864837.797574:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1d7480 x1874712086981376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864837.797594:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086981376:0@lo:13: 00010000:00080000:3.0:1787864837.800021:0:6747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1d61c0 x1874712086981504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864853 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864837.800037:0:6747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981504:0@lo:7: 00000004:00080000:3.0:1787864837.800050:0:6747:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787864837.800101:0:6747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981632:0@lo:5: 00000100:00100000:3.0:1787864837.800160:0:6747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864837.800214:0:6747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864837.800372:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981632 00000100:00100000:1.0:1787864837.800379:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981632 00000100:00100000:1.0:1787864837.800446:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864837.800455:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6747:x1874712086981632:12345-0@lo:5: 00002000:00080000:1.0:1787864837.800478:0:6694:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787864837.800482:0:6694:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787864837.800787:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6747:x1874712086981632:12345-0@lo:5: Request processed in 333us (625us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787864837.800795:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787864837.801083:0:6747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c43c0 x1874712086981632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864853 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864837.801096:0:6747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c43c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981632:0@lo:5: 00000004:00080000:3.0:1787864837.801106:0:6747:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787864837.801197:0:6747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981760:0@lo:700: 00000100:00100000:3.0:1787864837.801228:0:6747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864837.801246:0:6747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864837.801265:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981760 00000100:00100000:3.0:1787864837.801269:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981760 00000100:00100000:3.0:1787864837.801297:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864837.801304:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6747:x1874712086981760:12345-0@lo:700: 00000100:00100000:3.0:1787864837.801330:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874712086981888:0@lo:700: 00000100:00100000:3.0:1787864837.801540:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864837.801558:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864837.801608:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086981888 00000100:00100000:0.0:1787864837.801612:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086981888 00000100:00100000:0.0:1787864837.801643:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864837.801649:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874712086981888:12345-0@lo:700: 00000004:00080000:2.0:1787864837.832556:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787864837.889012:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787864837.895113:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874712086981888:12345-0@lo:700: Request processed in 93456us (93565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864837.895127:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787864837.895224:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c4000 x1874712086981888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787864853 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864837.895239:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874712086981888:0@lo:700: 40000000:02000000:1.0:1787864837.895252:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787864837.962659:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787864837.962692:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787864837.962940:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6747:x1874712086981760:12345-0@lo:700: Request processed in 161632us (161707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864837.962958:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787864837.963054:0:6747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c5e00 x1874712086981760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864853 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864837.963066:0:6747:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787864837.963083:0:6747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086981760:0@lo:700: 00000004:02000040:3.0:1787864838.053080:0:6747:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787864838.062660:0:6747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086982016:0@lo:5: 00000100:00100000:3.0:1787864838.062969:0:6747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864838.063011:0:6747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864838.065627:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982016 00000100:00100000:2.0:1787864838.065638:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982016 00000100:00100000:2.0:1787864838.065703:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864838.065713:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6747:x1874712086982016:12345-0@lo:5: 00002000:00080000:2.0:1787864838.073749:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787864838.073768:0:6695:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787864838.082160:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6747:x1874712086982016:12345-0@lo:5: Request processed in 16442us (19185us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787864838.082181:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787864838.082194:0:6747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c5e00 x1874712086982016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864854 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864838.082212:0:6747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6747:1874712086982016:0@lo:5: 00000004:00080000:3.0:1787864838.082228:0:6747:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787864838.203539:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864839.231420:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864840.252929:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864841.281930:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864842.299717:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864842.748611:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086982528:0@lo:400: 00000100:00100000:3.0:1787864842.748721:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864842.748773:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864842.748779:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086982144:0@lo:400: 00000100:00100000:3.0:1787864842.748808:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864842.748838:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086982272:0@lo:400: 00000100:00100000:3.0:1787864842.748881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864842.748905:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864842.748910:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086982400:0@lo:400: 00000100:00100000:3.0:1787864842.748931:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864842.748972:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982528 00000100:00100000:3.0:1787864842.748979:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982528 00000100:00100000:1.0:1787864842.749273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982144 00000100:00100000:1.0:1787864842.749285:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982144 00000100:00100000:1.0:1787864842.749331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864842.749341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3317:x1874712086982144:12345-0@lo:400: 00000100:00100000:1.0:1787864842.749421:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3317:x1874712086982144:12345-0@lo:400: Request processed in 82us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864842.749429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864842.749960:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864842.749970:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086982528:12345-0@lo:400: 00000100:00100000:3.0:1787864842.750027:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086982528:12345-0@lo:400: Request processed in 48us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864842.750035:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864842.750064:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982272 00000100:00100000:3.0:1787864842.750069:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982272 00000100:00100000:3.0:1787864842.750093:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982400 00000100:00100000:3.0:1787864842.750096:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982400 00000100:00100000:3.0:1787864842.750116:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864842.750122:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086982272:12345-0@lo:400: 00000100:00100000:3.0:1787864842.750157:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086982272:12345-0@lo:400: Request processed in 36us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864842.750163:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864842.750176:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787864842.750181:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086982400:12345-0@lo:400: 00000100:00100000:3.0:1787864842.750208:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086982400:12345-0@lo:400: Request processed in 27us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864842.750213:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787864842.750234:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864842.750238:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864842.750271:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa210d4cf00 x1874712086982400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864842.750287:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086982400:0@lo:400: 00010000:00080000:3.0:1787864842.750298:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c0c7840 x1874712086982272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864842.750307:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086982272:0@lo:400: 00000100:00100000:3.0:1787864842.750354:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086982144:0@lo:400: 00010000:00080000:3.0:1787864842.750375:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa210d4e1c0 x1874712086982528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864842.750385:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086982528:0@lo:400: 00000001:02000400:2.0:1787864842.983102:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787864843.278270:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864843.278295:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086982656:0@lo:13: 00000100:00100000:3.0:1787864843.278389:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864843.284996:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982656 00000100:00100000:2.0:1787864843.285011:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982656 00000100:00100000:2.0:1787864843.285112:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864843.285122:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086982656:12345-0@lo:13: 00002000:00000024:2.0:1787864843.285157:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864843.285239:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712086982656:12345-0@lo:13: Request processed in 119us (6850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864843.285246:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787864843.285296:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa210d4e1c0 x1874712086982656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864843.285326:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086982656:0@lo:13: 00010000:00010000:1.0:1787864843.326641:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787864843.384918:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787864844.347731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864845.372349:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864846.396348:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864847.420617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864847.874516:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086983040:0@lo:400: 00000100:00100000:0.0:1787864847.874585:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864847.874679:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864847.874687:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086983168:0@lo:400: 00000100:00100000:0.0:1787864847.874716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864847.874753:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983168 00000100:00100000:0.0:1787864847.874759:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983168 00000100:00100000:0.0:1787864847.874813:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864847.874822:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086983168:12345-0@lo:400: 00000100:00100000:0.0:1787864847.874876:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086983168:12345-0@lo:400: Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864847.874883:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787864847.874920:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1ccf00 x1874712086983168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864847.874930:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787864847.874949:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086983168:0@lo:400: 00000100:00100000:1.0:1787864847.875308:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086982784:0@lo:400: 00000100:00100000:1.0:1787864847.875346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864847.875380:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864847.875387:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086982912:0@lo:400: 00000100:00100000:1.0:1787864847.875438:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864847.875522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982784 00000100:00100000:2.0:1787864847.875528:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982784 00000100:00100000:2.0:1787864847.875566:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787864847.875575:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3315:x1874712086982784:12345-0@lo:400: 00000100:00100000:2.0:1787864847.875625:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3315:x1874712086982784:12345-0@lo:400: Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864847.875635:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787864847.875826:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086982784:0@lo:400: 00000100:00080000:0.0:1787864847.877533:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864847.877555:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983040 00000100:00100000:0.0:1787864847.877563:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983040 00000100:00100000:0.0:1787864847.877632:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086982912 00000100:00100000:0.0:1787864847.877636:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086982912 00000100:00100000:0.0:1787864847.877667:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864847.877677:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086983040:12345-0@lo:400: 00000100:00100000:0.0:1787864847.877760:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086983040:12345-0@lo:400: Request processed in 85us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864847.877767:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864847.877782:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864847.877788:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086982912:12345-0@lo:400: 00000100:00100000:0.0:1787864847.877824:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086982912:12345-0@lo:400: Request processed in 36us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864847.877829:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787864847.877870:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cc000 x1874712086982912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864847.877884:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086982912:0@lo:400: 00010000:00080000:0.0:1787864847.877914:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cd680 x1874712086983040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864847.877923:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086983040:0@lo:400: 00000100:00080000:1.0:1787864847.878232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864848.383497:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983296:0@lo:13: 00000100:00100000:0.0:1787864848.383564:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864848.392930:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983296 00000100:00100000:2.0:1787864848.392945:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983296 00000100:00100000:3.0:1787864848.393083:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864848.393093:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983296:12345-0@lo:13: 00002000:00000024:3.0:1787864848.393135:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864848.393216:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983296:12345-0@lo:13: Request processed in 124us (9651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864848.393224:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787864848.393377:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa210d4cb40 x1874712086983296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864848.393416:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983296:0@lo:13: 00010000:00010000:1.0:1787864848.452697:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864849.469876:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864850.492597:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864851.516468:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864852.543292:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864852.988610:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983808:0@lo:400: 00000100:00100000:3.0:1787864852.988679:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864852.988734:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864852.988740:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086983424:0@lo:400: 00000100:00100000:3.0:1787864852.988767:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864852.988799:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983808 00000100:00100000:3.0:1787864852.988806:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983808 00000100:00100000:3.0:1787864852.988862:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864852.988871:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983808:12345-0@lo:400: 00000100:00100000:3.0:1787864852.988921:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983808:12345-0@lo:400: Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864852.988929:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787864852.988964:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1ccf00 x1874712086983808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864852.988990:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983808:0@lo:400: 00000100:00100000:0.0:1787864852.988999:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712086983552:0@lo:400: 00000100:00100000:0.0:1787864852.989030:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864852.989080:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983552 00000100:00100000:3.0:1787864852.989084:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983552 00000100:00100000:3.0:1787864852.989112:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787864852.989118:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712086983552:12345-0@lo:400: 00000100:00100000:1.0:1787864852.989235:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983424 00000100:00100000:1.0:1787864852.989239:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983424 00000100:00100000:1.0:1787864852.989277:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787864852.989284:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3315:x1874712086983424:12345-0@lo:400: 00000100:00100000:1.0:1787864852.989874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3315:x1874712086983424:12345-0@lo:400: Request processed in 588us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864852.989883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787864852.989914:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864852.990199:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712086983552:12345-0@lo:400: Request processed in 1079us (1167us total) trans 0 rc 0/0 00010000:00080000:0.0:1787864852.990215:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cf0c0 x1874712086983552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864852.990237:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712086983552:0@lo:400: 00000100:00100000:0.0:1787864852.990272:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864852.990273:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864852.990284:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086983680:0@lo:400: 00000100:00100000:0.0:1787864852.990325:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864852.990385:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086983424:0@lo:400: 00000100:00100000:1.0:1787864852.990411:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983680 00000100:00100000:1.0:1787864852.990417:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983680 00000100:00100000:1.0:1787864852.990454:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864852.990461:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086983680:12345-0@lo:400: 00000100:00100000:1.0:1787864852.990510:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086983680:12345-0@lo:400: Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864852.990517:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787864852.990536:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787864852.990641:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cda40 x1874712086983680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864852.990653:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086983680:0@lo:400: 00000100:00100000:3.0:1787864853.499582:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864853.499606:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983936:0@lo:13: 00000100:00100000:3.0:1787864853.499680:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.499959:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086983936 00000100:00100000:3.0:1787864853.499967:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086983936 00000100:00100000:3.0:1787864853.500021:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864853.500033:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983936:12345-0@lo:13: 00002000:00000024:3.0:1787864853.500068:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864853.500179:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086983936:12345-0@lo:13: Request processed in 147us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.500197:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787864853.501521:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa210d4f0c0 x1874712086983936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864853.501547:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086983936:0@lo:13: 00000020:01000004:1.0:1787864853.543008:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787864853.543012:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787864853.543133:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa105678000 00000020:01000004:1.0:1787864853.543146:0:7627:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787864853.543157:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787864853.543175:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa23b673490) 00000020:00000080:1.0:1787864853.543194:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787864853.559715:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787864853.560001:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1787864853.564964:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787864853.584856:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787864853.594368:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787864853.594428:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787864853.594485:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787864853.594510:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787864853.594829:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787864853.594840:0:7627:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787864853.594849:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa63eebe186191831 00000020:01000004:2.0:1787864853.594856:0:7627:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787864853.594875:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787864853.594878:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787864853.594883:0:7627:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787864853.594900:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787864853.594904:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787864853.617938:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787864853.617973:0:7627:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787864853.617977:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787864853.617979:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864853.617980:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864853.617981:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864853.617982:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864853.617983:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864853.617985:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864853.617986:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864853.617988:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864853.617993:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864853.617995:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864853.617998:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787864853.618000:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787864853.618001:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864853.618002:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864853.618003:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864853.618004:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864853.618005:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864853.618006:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864853.618007:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864853.618007:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864853.618008:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864853.618009:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864853.618035:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787864853.618052:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086984064:0@lo:253: 00000100:00100000:2.0:1787864853.618119:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.618175:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864853.618376:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984064 00000100:00100000:1.0:1787864853.618383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984064 00000100:00100000:1.0:1787864853.618454:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864853.618463:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:7627:x1874712086984064:12345-0@lo:253: 20000000:01000000:1.0:1787864853.618489:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787864853.618492:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787864853.618497:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787864853.618500:0:5844:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787864853.620689:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864853.621556:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787864853.621577:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787864853.621624:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787864853.621631:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787864853.621662:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787864853.621728:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787864853.624795:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787864853.625363:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:1.0:1787864853.625366:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787864853.625622:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787864853.625633:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787864853.625736:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787864853.625747:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:1.0:1787864853.625782:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787864853.625792:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787864853.625914:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787864853.625966:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787864853.627629:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787864853.627659:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:1.0:1787864853.627662:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787864853.627700:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787864853.627709:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787864853.627739:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787864853.627747:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:1.0:1787864853.627797:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787864853.627947:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787864853.628003:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787864853.628042:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787864853.628060:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787864853.628062:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787864853.628069:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787864853.628070:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787864853.628072:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787864853.628147:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787864853.628150:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787864853.628353:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787864853.628356:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787864853.629573:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787864853.629646:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787864853.629701:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787864853.630218:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787864853.630285:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787864853.630322:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787864853.630334:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787864853.630337:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787864853.630901:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787864853.630949:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787864853.630997:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787864853.631242:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787864853.631295:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787864853.631352:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787864853.631367:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787864853.631369:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787864853.632361:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787864853.632723:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787864853.632765:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787864853.632846:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787864853.632860:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787864853.632862:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864853.634473:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864853.634563:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864853.634596:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787864853.635134:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787864853.635179:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787864853.635263:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1787864853.635285:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864853.635303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635319:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191774 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635326:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619179e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635333:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635339:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635345:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635352:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635388:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635432:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.635446:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984192:0@lo:104: 00000100:00100000:3.0:1787864853.635522:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864853.635572:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635580:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 16 pid: 5842 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.635588:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984320:0@lo:104: 00010000:00010000:3.0:1787864853.635613:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635620:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 16 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.635627:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984448:0@lo:104: 00010000:00010000:3.0:1787864853.635648:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635657:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 16 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.635664:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984576:0@lo:104: 00010000:00010000:3.0:1787864853.635685:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.635692:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 16 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.635699:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984704:0@lo:104: 00000100:00100000:3.0:1787864853.635726:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.635901:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864853.635918:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.635941:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.635950:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.635958:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.635967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984192 00000100:00100000:2.0:1787864853.635973:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984192 00000100:00100000:2.0:1787864853.636006:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984320 00000100:00100000:2.0:1787864853.636009:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984320 00000100:00100000:2.0:1787864853.636018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984448 00000100:00100000:2.0:1787864853.636020:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984448 00000100:00100000:2.0:1787864853.636028:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984576 00000100:00100000:2.0:1787864853.636030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984576 00000100:00100000:2.0:1787864853.636050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984704 00000100:00100000:2.0:1787864853.636054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984704 00000100:00100000:2.0:1787864853.636066:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864853.636073:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210deb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:5844:x1874712086984192:12345-0@lo:104: 00010000:00010000:2.0:1787864853.636084:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.636147:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864853.636153:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210deb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:5844:x1874712086984192:12345-0@lo:104: Request processed in 81us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.636160:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864853.636201:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864853.636207:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5844:x1874712086984320:12345-0@lo:104: 00010000:00010000:2.0:1787864853.636215:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.636245:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864853.636250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:5844:x1874712086984320:12345-0@lo:104: Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.636266:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864853.636278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864853.636284:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:5844:x1874712086984448:12345-0@lo:104: 00010000:00010000:2.0:1787864853.636291:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.636315:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787864853.636320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:5844:x1874712086984448:12345-0@lo:104: Request processed in 37us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.636337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864853.636349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864853.636355:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:5844:x1874712086984576:12345-0@lo:104: 00010000:00010000:2.0:1787864853.636362:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.636426:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787864853.636431:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:5844:x1874712086984576:12345-0@lo:104: Request processed in 77us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.636437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864853.636449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864853.636455:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5844:x1874712086984704:12345-0@lo:104: 00010000:00010000:2.0:1787864853.636462:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.636486:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787864853.636491:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5844:x1874712086984704:12345-0@lo:104: Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.636496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787864853.636679:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787864853.636686:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636693:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864853.636697:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636704:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864853.636711:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864853.636717:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864853.636753:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636760:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864853.636779:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636786:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe18619181c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191823 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636797:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787864853.636800:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636816:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031400 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864853.636819:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636825:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864853.636831:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864853.636836:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864853.636850:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636856:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864853.636861:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636867:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa200031400/0xa63eebe1861917e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636876:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787864853.636880:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636886:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864853.636888:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636905:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864853.636912:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864853.636917:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864853.636930:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636936:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864853.636951:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636958:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe1861917c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917cf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636967:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864853.636970:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636975:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864853.636978:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.636984:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864853.636990:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864853.637000:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864853.637014:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637019:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864853.637024:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637031:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619179e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917a5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637040:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864853.637043:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637048:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219851200 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864853.637052:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637058:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864853.637063:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864853.637068:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864853.637079:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637084:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864853.637094:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637100:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851200/0xa63eebe186191774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619177b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637115:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864853.637116:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864853.637118:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864853.637132:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086984832:0@lo:103: 00000100:00100000:1.0:1787864853.637167:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.637198:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086985344:0@lo:103: 00000100:00100000:1.0:1787864853.637217:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.637234:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864853.637240:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086984960:0@lo:103: 00000100:00100000:1.0:1787864853.637269:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.637299:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086985088:0@lo:103: 00000100:00100000:1.0:1787864853.637330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.637344:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864853.637349:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086985216:0@lo:103: 00000100:00100000:1.0:1787864853.637366:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.637390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984832 00000100:00100000:1.0:1787864853.637422:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984832 00010000:00010000:1.0:1787864853.637443:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 17 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.637458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985344 00000100:00100000:1.0:1787864853.637460:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985344 00010000:00010000:1.0:1787864853.637471:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 18 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.637491:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086984960 00000100:00100000:1.0:1787864853.637494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086984960 00010000:00010000:1.0:1787864853.637506:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 19 pid: 5842 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.637516:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985088 00000100:00100000:1.0:1787864853.637518:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985088 00010000:00010000:1.0:1787864853.637528:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 20 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.637537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985216 00000100:00100000:1.0:1787864853.637540:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985216 00010000:00010000:1.0:1787864853.637561:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 21 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.637573:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864853.637580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3317:x1874712086984832:12345-0@lo:103: 00010000:00010000:1.0:1787864853.637590:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864853.637594:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 21 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637603:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 21 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637619:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864853.637649:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3317:x1874712086984832:12345-0@lo:103: Request processed in 69us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.637655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864853.637670:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864853.637682:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3317:x1874712086985344:12345-0@lo:103: 00010000:00010000:1.0:1787864853.637689:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864853.637693:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 20 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637702:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 20 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637712:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864853.637733:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3317:x1874712086985344:12345-0@lo:103: Request processed in 53us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.637740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864853.637751:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864853.637757:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712086984960:12345-0@lo:103: 00010000:00010000:1.0:1787864853.637764:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864853.637768:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 19 pid: 5842 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637776:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 19 pid: 5842 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637785:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864853.637805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712086984960:12345-0@lo:103: Request processed in 48us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.637810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864853.637822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864853.637827:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712086985088:12345-0@lo:103: 00010000:00010000:1.0:1787864853.637833:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864853.637843:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 18 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637850:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 18 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637859:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864853.637885:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712086985088:12345-0@lo:103: Request processed in 59us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.637892:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864853.637903:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864853.637909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712086985216:12345-0@lo:103: 00010000:00010000:1.0:1787864853.637916:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864853.637919:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 17 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637928:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 17 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637939:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637947:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637959:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637965:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637971:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637984:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.637989:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242143e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864853.637993:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.638000:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.638009:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.638018:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864853.638040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712086985216:12345-0@lo:103: Request processed in 131us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.638046:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787864853.638069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864853.638091:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086985216:0@lo:103: 00000100:00100000:1.0:1787864853.638100:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086985088:0@lo:103: 00000100:00100000:1.0:1787864853.638127:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086984960:0@lo:103: 00000100:00100000:1.0:1787864853.638134:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086984832:0@lo:103: 00000100:00100000:1.0:1787864853.638140:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086985344:0@lo:103: 00010000:00010000:3.0:1787864853.638463:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336b000/0xa63eebe186191823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe18619181c expref: 16 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.638474:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984192:0@lo:104: 00010000:00010000:3.0:1787864853.638483:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850e00/0xa63eebe1861917eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861917e4 expref: 15 pid: 5842 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.638491:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4c780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984320:0@lo:104: 00010000:00010000:3.0:1787864853.638499:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a000/0xa63eebe1861917cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861917c8 expref: 14 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.638506:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984448:0@lo:104: 00010000:00010000:3.0:1787864853.638514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850000/0xa63eebe1861917a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe18619179e expref: 13 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.638520:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984576:0@lo:104: 00010000:00010000:3.0:1787864853.638528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa200031c00/0xa63eebe18619177b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191774 expref: 12 pid: 5844 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.638536:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5844:1874712086984704:0@lo:104: 00010000:00010000:3.0:1787864853.638558:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.638568:0:5844:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.638573:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.638592:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242143e00/0xa63eebe186191838 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787864853.638606:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787864853.689943:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086984064:0@lo:253: 10000000:01000000:1.0:1787864853.689960:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787864853.689977:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787864853.689979:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787864853.689981:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864853.689982:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787864853.689983:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864853.689984:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864853.689986:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787864853.689987:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787864853.689988:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864853.689989:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787864853.690011:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa105678000 from lustre-OST0001 10000000:01000000:1.0:1787864853.690034:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787864853.690036:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787864853.690044:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa210db4ed8 local copy 10000000:01000000:1.0:1787864853.690047:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787864853.690079:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.690090:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.690098:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.690114:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985472:0@lo:101: 00000100:00100000:1.0:1787864853.690151:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.690197:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2059bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.690237:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:7627:x1874712086984064:12345-0@lo:253: Request processed in 71382us (71723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.690248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787864853.690286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985472 00000100:00100000:2.0:1787864853.690290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985472 00000100:00100000:2.0:1787864853.690322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787864853.690393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+11:7627:x1874712086985472:12345-0@lo:101: 00010000:00010000:2.0:1787864853.690425:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864853.690444:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850c00/0xa63eebe186191846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619183f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.690465:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850c00/0xa63eebe186191846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619183f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.690474:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850c00/0xa63eebe186191846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619183f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.690483:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850c00, rc 0) 00000100:00100000:2.0:1787864853.691179:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985472:12345-0@lo:101: Request processed in 789us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.691187:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864853.691299:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985472:0@lo:101: 00010000:00010000:1.0:1787864853.691316:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.691326:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.691560:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985600:0@lo:501: 00000100:00100000:1.0:1787864853.692249:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.692305:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2059bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.692419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985600 00000100:00100000:2.0:1787864853.692426:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985600 00000100:00100000:2.0:1787864853.692464:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787864853.692472:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985600:12345-0@lo:501: 00000100:00100000:2.0:1787864853.692866:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985600:12345-0@lo:501: Request processed in 393us (617us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864853.692875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787864853.692943:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985600:0@lo:501: 10000000:01000000:1.0:1787864853.692961:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787864853.692993:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787864853.692999:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.693008:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.693015:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.693076:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787864853.693099:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa105678000 10000000:01000000:1.0:1787864853.693104:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787864853.693109:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787864853.693111:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864853.693116:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787864853.693118:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787864853.693142:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.693149:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.693171:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.693187:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985728:0@lo:101: 00000100:00100000:1.0:1787864853.693218:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864853.693290:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864853.693296:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.693304:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787864853.693308:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.693315:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864853.693480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985728 00000100:00100000:0.0:1787864853.693486:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985728 00000100:00100000:0.0:1787864853.693523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787864853.693531:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985728:12345-0@lo:101: 00010000:00010000:0.0:1787864853.693540:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864853.693553:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619184d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864853.693584:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619184d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864853.693682:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2059bdcc0 going to sleep for 11 seconds 10000000:00010000:2.0:1787864853.693738:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864853.693744:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864853.693764:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.693770:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864853.693795:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.693803:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe18619183f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa63eebe186191846 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.693815:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864853.693817:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864853.693818:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864853.693826:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864853.693837:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086985856:0@lo:103: 00000100:00100000:2.0:1787864853.693868:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.693898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985856 00000100:00100000:2.0:1787864853.693902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985856 00000100:00100000:2.0:1787864853.693930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864853.693937:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3317:x1874712086985856:12345-0@lo:103: 00010000:00010000:2.0:1787864853.693945:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864853.694076:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850c00/0xa63eebe186191846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe18619183f expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.694089:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864853.694134:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3317:x1874712086985856:12345-0@lo:103: Request processed in 196us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.694141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864853.694207:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086985856:0@lo:103: 00010000:00010000:0.0:1787864853.694250:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619184d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864853.694267:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b400, rc 0) 00000100:00100000:0.0:1787864853.694359:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985728:12345-0@lo:101: Request processed in 828us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864853.694365:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864853.694652:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985728:0@lo:101: 00010000:00010000:1.0:1787864853.694665:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864853.694675:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864853.694823:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985984:0@lo:501: 00000100:00100000:0.0:1787864853.694851:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864853.694910:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa205310300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.694945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086985984 00000100:00100000:2.0:1787864853.694949:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086985984 00000100:00100000:2.0:1787864853.695011:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787864853.695019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985984:12345-0@lo:501: 00000100:00100000:2.0:1787864853.695230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086985984:12345-0@lo:501: Request processed in 211us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.695237:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787864853.695305:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086985984:0@lo:501: 00000100:00100000:0.0:1787864853.695343:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986112:0@lo:503: 00000100:00100000:0.0:1787864853.695379:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864853.695601:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa205310300 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.695737:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986112 00000100:00100000:3.0:1787864853.695743:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986112 00000100:00100000:3.0:1787864853.695770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864853.695776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986112:12345-0@lo:503: 00000100:00100000:3.0:1787864853.695927:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986112:12345-0@lo:503: Request processed in 150us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.695933:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787864853.696270:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986112:0@lo:503: 00000040:00080000:0.0:1787864853.696629:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787864853.696689:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986240:0@lo:502: 00000100:00100000:0.0:1787864853.696737:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864853.696765:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa205310300 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.696930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986240 00000100:00100000:3.0:1787864853.696934:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986240 00000100:00100000:3.0:1787864853.696958:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787864853.696964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986240:12345-0@lo:502: 00000100:00100000:3.0:1787864853.697134:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986240:12345-0@lo:502: Request processed in 168us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.697142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787864853.698937:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986240:0@lo:502: 00000040:00080000:0.0:1787864853.699278:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787864853.699358:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787864853.699583:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787864853.699652:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787864853.699686:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787864853.699717:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787864853.699757:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986368:0@lo:502: 00000100:00100000:0.0:1787864853.699828:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864853.699873:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa205310300 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.700002:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986368 00000100:00100000:3.0:1787864853.700008:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986368 00000100:00100000:3.0:1787864853.700045:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787864853.700053:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986368:12345-0@lo:502: 00000100:00100000:3.0:1787864853.700241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986368:12345-0@lo:502: Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.700248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787864853.700449:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986368:0@lo:502: 00000040:00080000:0.0:1787864853.700538:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787864853.700547:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787864853.701202:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787864853.701217:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787864853.701224:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864853.701226:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787864853.701233:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864853.701247:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa205940000) 00000020:00000080:3.0:1787864853.701279:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787864853.701285:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787864853.701347:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa105678000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787864853.701354:0:7635:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787864853.701360:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa63eebe186191862 00010000:00010000:3.0:1787864853.706535:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787864853.706995:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787864853.715577:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787864853.716187:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787864853.728347:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787864853.730157:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787864853.735918:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787864853.735936:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864853.735944:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864853.735947:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787864853.735951:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864853.735955:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864853.735957:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787864853.735960:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787864853.735962:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787864853.736028:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864853.736032:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864853.736033:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787864853.736036:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787864853.739299:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787864853.739341:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787864853.741682:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864853.741699:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864853.741709:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105678000 from 1 10000000:01000000:0.0:1787864853.741712:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864853.741746:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864853.741753:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864853.741763:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864853.741798:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986496:0@lo:101: 00000100:00100000:0.0:1787864853.741938:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864853.742266:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa205310540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.742321:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986496 00000100:00100000:3.0:1787864853.742328:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986496 00000100:00100000:3.0:1787864853.743459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787864853.743475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:7627:x1874712086986496:12345-0@lo:101: 00010000:00010000:3.0:1787864853.743490:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864853.743506:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191869 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.743530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191869 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.743541:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191869 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.743549:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242143e00, rc 0) 00000100:00100000:3.0:1787864853.743625:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986496:12345-0@lo:101: Request processed in 156us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.743642:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787864853.743990:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986496:0@lo:101: 00010000:00010000:2.0:1787864853.744007:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.744016:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864853.744136:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986624:0@lo:501: 00000100:00100000:2.0:1787864853.744171:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.744955:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864853.747127:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986624 00000100:00100000:1.0:1787864853.747142:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986624 00000100:00100000:1.0:1787864853.747374:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787864853.747385:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986624:12345-0@lo:501: 00000100:00100000:1.0:1787864853.747705:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986624:12345-0@lo:501: Request processed in 321us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.747712:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787864853.747959:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986624:0@lo:501: 00000100:00100000:2.0:1787864853.748006:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986752:0@lo:503: 00000100:00100000:2.0:1787864853.748052:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.748079:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864853.748214:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986752 00000100:00100000:1.0:1787864853.748219:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986752 00000100:00100000:1.0:1787864853.748242:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864853.748248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986752:12345-0@lo:503: 00000100:00100000:1.0:1787864853.748573:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986752:12345-0@lo:503: Request processed in 324us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.748599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787864853.748947:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986752:0@lo:503: 00000040:00080000:2.0:1787864853.749436:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864853.749513:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986880:0@lo:502: 00000100:00100000:2.0:1787864853.749559:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.749585:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864853.749720:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086986880 00000100:00100000:1.0:1787864853.749725:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086986880 00000100:00100000:1.0:1787864853.749751:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787864853.749757:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986880:12345-0@lo:502: 00000100:00100000:1.0:1787864853.750006:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086986880:12345-0@lo:502: Request processed in 248us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.750014:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864853.750147:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086986880:0@lo:502: 00000040:00080000:2.0:1787864853.750511:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787864853.750562:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787864853.750598:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987008:0@lo:502: 00000100:00100000:2.0:1787864853.751056:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.751085:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.751152:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987008 00000100:00100000:3.0:1787864853.751159:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987008 00000100:00100000:3.0:1787864853.751275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864853.751285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086987008:12345-0@lo:502: 00000100:00100000:3.0:1787864853.751475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086987008:12345-0@lo:502: Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.751482:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787864853.751684:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987008:0@lo:502: 00000040:00080000:2.0:1787864853.751868:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787864853.751882:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787864853.752642:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864853.752652:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864853.752654:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787864853.752660:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa105678000 00000020:00000080:1.0:1787864853.752662:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864853.752682:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864853.752685:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864853.752686:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787864853.752689:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787864853.752913:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787864853.752933:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864853.752952:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.752970:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864853.753007:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787864853.753011:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa105678000 10000000:01000000:2.0:1787864853.753014:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa105678000 10000000:01000000:2.0:1787864853.753018:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864853.753023:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa105678000 from 1 10000000:01000000:2.0:1787864853.753026:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864853.753055:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.753062:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.753071:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864853.753088:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987136:0@lo:101: 00000100:00100000:2.0:1787864853.753140:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.753177:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.753296:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987136 00000100:00100000:3.0:1787864853.753302:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987136 00000100:00100000:3.0:1787864853.753342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864853.753350:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086987136:12345-0@lo:101: 00010000:00010000:3.0:1787864853.753361:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864853.753373:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.753393:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191877 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.753436:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191877 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.753444:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242142600, rc 0) 00000100:00100000:3.0:1787864853.753479:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987136:12345-0@lo:101: Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.753485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864853.754629:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987136:0@lo:101: 00010000:00010000:3.0:1787864853.754665:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.754676:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.754778:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987264:0@lo:501: 00000100:00100000:3.0:1787864853.754930:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.754967:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864853.755028:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987264 00000100:00100000:0.0:1787864853.755033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987264 00000100:00100000:0.0:1787864853.755070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787864853.755077:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987264:12345-0@lo:501: 00000100:00100000:0.0:1787864853.755429:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987264:12345-0@lo:501: Request processed in 351us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864853.755437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787864853.755528:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987264:0@lo:501: 00000100:00100000:3.0:1787864853.755557:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987392:0@lo:503: 00000100:00100000:3.0:1787864853.755601:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.755624:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864853.755722:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987392 00000100:00100000:0.0:1787864853.755727:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987392 00000100:00100000:0.0:1787864853.755757:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787864853.755764:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987392:12345-0@lo:503: 00000100:00100000:0.0:1787864853.756010:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987392:12345-0@lo:503: Request processed in 246us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864853.756017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864853.756093:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987392:0@lo:503: 00000040:00080000:3.0:1787864853.756471:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864853.756536:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987520:0@lo:502: 00000100:00100000:3.0:1787864853.756568:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.760045:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864853.760210:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987520 00000100:00100000:0.0:1787864853.760219:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987520 00000100:00100000:0.0:1787864853.760294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787864853.760304:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987520:12345-0@lo:502: 00000100:00100000:0.0:1787864853.760598:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987520:12345-0@lo:502: Request processed in 294us (4028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864853.760606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787864853.760821:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987520:0@lo:502: 00000040:00080000:3.0:1787864853.761180:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787864853.761247:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787864853.761293:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787864853.761357:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787864853.761428:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787864853.761484:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787864853.761523:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787864853.761556:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787864853.761627:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787864853.761663:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787864853.761698:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787864853.761744:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787864853.761778:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787864853.761810:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787864853.761854:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787864853.761886:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787864853.761916:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787864853.761979:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787864853.762019:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787864853.762074:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787864853.762125:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787864853.762164:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787864853.762202:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787864853.762279:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787864853.762325:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787864853.762361:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787864853.762441:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787864853.762479:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787864853.762510:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787864853.762566:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787864853.762606:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787864853.762639:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787864853.762671:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787864853.762718:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787864853.762754:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787864853.762819:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787864853.762852:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787864853.762892:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987648:0@lo:502: 00000100:00100000:3.0:1787864853.762959:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.763012:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.763293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987648 00000100:00100000:2.0:1787864853.763300:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987648 00000100:00100000:2.0:1787864853.763351:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864853.763360:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987648:12345-0@lo:502: 00000100:00100000:2.0:1787864853.763605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086987648:12345-0@lo:502: Request processed in 245us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.763612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787864853.764004:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086987648:0@lo:502: 00000040:00080000:3.0:1787864853.764097:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787864853.764110:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787864853.765320:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787864853.765335:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa205951a48) 00000020:00000080:0.0:1787864853.765364:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787864853.765477:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa105678000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787864853.765482:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa105678000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787864853.765484:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa105678000 3 00010000:00080000:0.0:1787864853.765510:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa22f7d6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787864853.768317:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787864853.768707:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787864853.768765:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787864853.768779:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa63eebe18619188c 00000100:00080000:1.0:1787864853.768790:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864853.768795:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa22f7d6000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787864853.768898:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f7e0f00 x1874712086987776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864853.768957:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712086987776:0@lo:38: 00000100:00100000:3.0:1787864853.769027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864853.769081:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787864853.769141:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086987904:0@lo:400: 00000100:00100000:1.0:1787864853.769168:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.769280:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864853.769286:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086988032:0@lo:400: 00000100:00100000:1.0:1787864853.769310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.769342:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987776 00000100:00100000:1.0:1787864853.769348:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987776 00000100:00100000:1.0:1787864853.769368:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086987904 00000100:00100000:1.0:1787864853.769370:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086987904 00000100:00100000:1.0:1787864853.769388:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988032 00000100:00100000:1.0:1787864853.769390:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988032 00000100:00100000:1.0:1787864853.769431:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864853.769440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086987904:12345-0@lo:400: 00000100:00100000:1.0:1787864853.769487:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086987904:12345-0@lo:400: Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.769494:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864853.769508:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864853.769515:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086988032:12345-0@lo:400: 00000100:00100000:1.0:1787864853.769540:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086988032:12345-0@lo:400: Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.769545:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864853.769556:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864853.769560:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1874712086987776:12345-0@lo:38: 00010000:00080000:1.0:1787864853.769579:0:5850:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1787864853.769684:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa63eebe186191893 00000004:00100000:1.0:1787864853.769698:0:5850:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787864853.769727:0:5850:0:(import.c:65:import_set_state_nolock()) ffff9fa23b393000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787864853.773975:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874712086987776:12345-0@lo:38: Request processed in 4404us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864853.773989:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787864853.774079:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa22f7e2940 x1874712086988032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864853.774095:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086988032:0@lo:400: 00010000:00080000:1.0:1787864853.774109:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa22f7e21c0 x1874712086987904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864853.774117:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086987904:0@lo:400: 00000100:00080000:0.0:1787864853.775717:0:7642:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9fa20c1cf840 x1874712086988160/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864853.775729:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f07f6c0 going to sleep for 0 seconds 00000040:00080000:1.0:1787864853.775996:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:3.0:1787864853.776320:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa22f7e0f00 x1874712086987776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864853.776332:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864853.776340:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787864853.776348:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787864853.776352:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787864853.776355:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787864853.776361:0:3314:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a4c4c441): req@ffff9fa20c1cf840 x1874712086988160/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864853.776584:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864853.779002:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f07f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864853.779089:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988160 00000100:00100000:2.0:1787864853.779097:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988160 00000100:00100000:2.0:1787864853.779200:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864853.779210:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874712086988160:12345-0@lo:901: 00000100:00100000:2.0:1787864853.779756:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874712086988160:12345-0@lo:901: Request processed in 547us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864853.779765:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864853.779841:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712086987776:0@lo:38: 00000020:01000000:3.0:1787864853.779875:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787864853.779906:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864853.779929:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.779940:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787864853.779986:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787864853.779988:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787864853.779990:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864853.779991:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864853.779992:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864853.779998:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864853.780000:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864853.780001:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864853.780003:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864853.780004:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864853.780005:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864853.780009:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787864853.780011:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864853.780012:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787864853.780013:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864853.780014:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864853.780015:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864853.780016:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864853.780017:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864853.780018:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864853.780019:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864853.780020:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864853.780020:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864853.780039:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787864853.780055:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086988288:0@lo:253: 00000100:00100000:3.0:1787864853.780096:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.780122:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.780138:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988288 00000100:00100000:3.0:1787864853.780142:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988288 00000100:00100000:3.0:1787864853.780170:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787864853.780177:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:7627:x1874712086988288:12345-0@lo:253: 20000000:01000000:3.0:1787864853.780372:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787864853.780385:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1787864853.781276:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787864853.781327:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cf840 x1874712086988160/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787864869 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864853.781341:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874712086988160:0@lo:901: 20000000:01000000:3.0:1787864853.809663:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787864853.809680:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787864853.809767:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787864853.809772:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787864853.809793:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.809811:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.809818:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.809854:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.809868:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 14 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864853.809881:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086988416:0@lo:104: 00000100:00100000:2.0:1787864853.809959:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864853.810007:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787864853.810056:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988416 00000100:00100000:3.0:1787864853.810063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988416 00000100:00100000:3.0:1787864853.810111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864853.810120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086988416:12345-0@lo:104: 00010000:00010000:3.0:1787864853.810132:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810199:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787864853.810205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:5865:x1874712086988416:12345-0@lo:104: Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.810212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787864853.810233:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864853.810239:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810245:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219851c00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864853.810249:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810266:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864853.810272:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864853.810277:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864853.810301:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810308:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864853.810324:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810332:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861917d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861917dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810357:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864853.810359:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864853.810360:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864853.810372:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086988544:0@lo:103: 00000100:00100000:3.0:1787864853.810431:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864853.810466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988544 00000100:00100000:3.0:1787864853.810470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988544 00010000:00010000:3.0:1787864853.810486:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 15 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.810505:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864853.810512:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:3317:x1874712086988544:12345-0@lo:103: 00010000:00010000:3.0:1787864853.810521:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864853.810526:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 15 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810536:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 15 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810550:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810557:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787864853.810568:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001210832s 00010000:00010000:3.0:1787864853.810572:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810598:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810605:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810611:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810616:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219850000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864853.810619:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810626:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810635:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864853.810645:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864853.810673:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:3317:x1874712086988544:12345-0@lo:103: Request processed in 162us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.810679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864853.810733:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086988544:0@lo:103: 00010000:00010000:2.0:1787864853.810926:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa200031a00/0xa63eebe1861917dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861917d6 expref: 14 pid: 5841 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864853.810937:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1874712086988416:0@lo:104: 00010000:00010000:2.0:1787864853.810957:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.810965:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.810971:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864853.810976:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850000/0xa63eebe18619189a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864853.821314:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:7627:x1874712086988288:12345-0@lo:253: Request processed in 41128us (41208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864853.821329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787864853.821485:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0743acf0-ff0b-46d8-9d09-7d582be6a838:7627:1874712086988288:0@lo:253: 10000000:01000000:0.0:1787864853.821501:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787864853.821505:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787864853.821506:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787864853.821508:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864853.821509:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864853.821511:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864853.821512:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864853.821513:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864853.821515:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864853.821516:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864853.821518:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864853.821519:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787864853.821533:0:7627:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787864853.829572:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787864853.829838:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787864853.830023:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787864853.830275:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787864853.830716:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1787864853.830872:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787864853.832017:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787864854.013333:0:7627:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787864854.013340:0:7627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787864854.013380:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787864854.013457:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787864854.013471:0:7627:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787864854.013485:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787864854.587587:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864855.611526:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864856.636580:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864857.661152:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864858.620893:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086988672:0@lo:13: 00000100:00100000:3.0:1787864858.620962:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864858.628508:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988672 00000100:00100000:1.0:1787864858.628523:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988672 00000100:00100000:1.0:1787864858.628602:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864858.628614:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086988672:12345-0@lo:13: 00002000:00000024:1.0:1787864858.628653:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787864858.628758:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864858.634021:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086988672:12345-0@lo:13: Request processed in 5399us (13047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864858.634037:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787864858.635734:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cf840 x1874712086988672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864858.635767:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086988672:0@lo:13: 00010000:00010000:2.0:1787864858.683793:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864859.133849:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086988928:0@lo:400: 00000100:00100000:3.0:1787864859.133917:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864859.133990:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787864859.133997:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086988800:0@lo:400: 00000100:00100000:3.0:1787864859.134026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864859.134046:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712086989312:0@lo:400: 00000100:00100000:3.0:1787864859.134065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864859.134088:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086989056:0@lo:400: 00000100:00100000:3.0:1787864859.134108:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864859.134124:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864859.134129:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086989184:0@lo:400: 00000100:00100000:3.0:1787864859.134152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864859.134196:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988928 00000100:00100000:3.0:1787864859.134203:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988928 00000100:00100000:3.0:1787864859.134247:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989312 00000100:00100000:3.0:1787864859.134250:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989312 00000100:00100000:3.0:1787864859.134274:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989056 00000100:00100000:3.0:1787864859.134277:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989056 00000100:00100000:3.0:1787864859.134302:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864859.134309:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086988928:12345-0@lo:400: 00000100:00100000:3.0:1787864859.134357:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086988928:12345-0@lo:400: Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864859.134364:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864859.134381:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864859.134387:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712086989312:12345-0@lo:400: 00000100:00100000:3.0:1787864859.134447:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712086989312:12345-0@lo:400: Request processed in 60us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864859.134453:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864859.134464:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864859.134471:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086989056:12345-0@lo:400: 00000100:00100000:1.0:1787864859.134774:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989184 00000100:00100000:1.0:1787864859.134780:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989184 00000100:00100000:1.0:1787864859.134812:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864859.134821:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086989184:12345-0@lo:400: 00000100:00100000:1.0:1787864859.134855:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086989184:12345-0@lo:400: Request processed in 36us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864859.134868:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787864859.134911:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864859.134929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086988800 00000100:00100000:1.0:1787864859.134933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086988800 00000100:00100000:1.0:1787864859.134973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787864859.134979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3316:x1874712086988800:12345-0@lo:400: 00000100:00100000:1.0:1787864859.135010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:3316:x1874712086988800:12345-0@lo:400: Request processed in 32us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864859.135015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787864859.135082:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086989056:12345-0@lo:400: Request processed in 610us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864859.135088:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787864859.135133:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4f840 x1874712086989184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864859.135146:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086989184:0@lo:400: 00010000:00080000:3.0:1787864859.135221:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4cb40 x1874712086989056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864859.135240:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086989056:0@lo:400: 00000100:00100000:3.0:1787864859.135271:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712086988800:0@lo:400: 00010000:00080000:3.0:1787864859.135281:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4d2c0 x1874712086989312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864859.135301:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712086989312:0@lo:400: 00010000:00080000:3.0:1787864859.135314:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4f480 x1874712086988928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864859.135322:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086988928:0@lo:400: 00010000:00010000:2.0:1787864859.725609:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864860.316791:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787864860.667534:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787864860.667542:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa23be5b800 from 30 10000000:01000000:2.0:1787864860.667547:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864860.667601:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.667612:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.667622:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.667644:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989440:0@lo:101: 00000100:00100000:2.0:1787864860.667721:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.667777:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864860.667863:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989440 00000100:00100000:3.0:1787864860.667870:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989440 00000100:00100000:3.0:1787864860.667930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787864860.667939:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086989440:12345-0@lo:101: 00010000:00010000:3.0:1787864860.667951:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864860.667963:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.667988:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.667999:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.668017:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242142400, rc 0) 00000100:00100000:3.0:1787864860.668062:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086989440:12345-0@lo:101: Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864860.668068:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787864860.668583:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989440:0@lo:101: 00010000:00010000:2.0:1787864860.668600:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.668610:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.668664:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989568:0@lo:501: 00000100:00100000:2.0:1787864860.668693:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.668719:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.668733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989568 00000100:00100000:2.0:1787864860.668737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989568 00000100:00100000:2.0:1787864860.668765:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787864860.668772:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086989568:12345-0@lo:501: 00000100:00100000:3.0:1787864860.673819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086989568:12345-0@lo:501: Request processed in 5039us (5117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864860.673833:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787864860.675992:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989568:0@lo:501: 00000100:00100000:2.0:1787864860.677677:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989696:0@lo:503: 00000100:00100000:2.0:1787864860.677786:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.678714:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.681952:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989696 00000100:00100000:1.0:1787864860.681967:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989696 00000100:00100000:1.0:1787864860.682171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787864860.682182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086989696:12345-0@lo:503: 00000100:00100000:1.0:1787864860.682618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086989696:12345-0@lo:503: Request processed in 437us (4831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.682627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787864860.682717:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086989696:0@lo:503: 00000100:00100000:3.0:1787864860.682918:0:8003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8003:1874712086989824:0@lo:502: 00000100:00100000:3.0:1787864860.682961:0:8003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.696550:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989824 00000100:00100000:2.0:1787864860.698087:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989824 00000100:00100000:2.0:1787864860.698153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787864860.698164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8003:x1874712086989824:12345-0@lo:502: 00000100:00100000:2.0:1787864860.699694:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8003:x1874712086989824:12345-0@lo:502: Request processed in 1526us (16727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.699716:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787864860.700369:0:8003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f07f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.700432:0:8003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8003:1874712086989824:0@lo:502: 00000100:00100000:1.0:1787864860.700500:0:8003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8003:1874712086989952:0@lo:502: 00000100:00100000:1.0:1787864860.700550:0:8003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864860.700582:0:8003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa1075e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.700707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086989952 00000100:00100000:2.0:1787864860.700713:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086989952 00000100:00100000:2.0:1787864860.700754:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864860.700762:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8003:x1874712086989952:12345-0@lo:502: 00000100:00100000:2.0:1787864860.700974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8003:x1874712086989952:12345-0@lo:502: Request processed in 212us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.700981:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787864860.701150:0:8003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8003:1874712086989952:0@lo:502: 00000040:00080000:1.0:1787864860.701172:0:8003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787864860.701331:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787864860.701348:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864860.701356:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.701366:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864860.701374:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787864860.701377:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787864860.701380:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787864860.701523:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.701532:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.701541:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.701556:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990080:0@lo:101: 00000100:00100000:2.0:1787864860.701591:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.701621:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.701667:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990080 00000100:00100000:1.0:1787864860.701672:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990080 00000100:00100000:1.0:1787864860.701705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787864860.701719:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086990080:12345-0@lo:101: 00010000:00010000:1.0:1787864860.701728:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864860.701739:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.701757:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918af expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.701767:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918af expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.701776:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a800, rc 0) 00000100:00100000:1.0:1787864860.701816:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990080:12345-0@lo:101: Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.701822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864860.701939:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990080:0@lo:101: 00010000:00010000:2.0:1787864860.701950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.701958:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.701995:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990208:0@lo:501: 00000100:00100000:2.0:1787864860.702019:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.702037:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.702076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990208 00000100:00100000:1.0:1787864860.702079:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990208 00000100:00100000:1.0:1787864860.702104:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787864860.702109:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990208:12345-0@lo:501: 00000100:00100000:1.0:1787864860.702318:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990208:12345-0@lo:501: Request processed in 208us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.702325:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787864860.702483:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990208:0@lo:501: 00000100:00100000:2.0:1787864860.702511:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990336:0@lo:503: 00000100:00100000:2.0:1787864860.702548:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.702566:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.702632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990336 00000100:00100000:1.0:1787864860.702636:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990336 00000100:00100000:1.0:1787864860.702657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787864860.702663:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990336:12345-0@lo:503: 00000100:00100000:1.0:1787864860.703108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990336:12345-0@lo:503: Request processed in 444us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.703125:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787864860.707056:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990336:0@lo:503: 00000100:00100000:3.0:1787864860.708377:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8006:1874712086990464:0@lo:502: 00000100:00100000:3.0:1787864860.708482:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.708522:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208044240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.708604:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990464 00000100:00100000:2.0:1787864860.708611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990464 00000100:00100000:2.0:1787864860.708653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864860.708661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8006:x1874712086990464:12345-0@lo:502: 00000100:00100000:2.0:1787864860.708922:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8006:x1874712086990464:12345-0@lo:502: Request processed in 260us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.708930:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787864860.709162:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8006:1874712086990464:0@lo:502: 00000020:01000000:3.0:1787864860.709187:0:8006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864860.709196:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864860.709198:0:8006:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864860.709203:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864860.709204:0:8006:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864860.709233:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8006:1874712086990592:0@lo:502: 00000100:00100000:3.0:1787864860.709268:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.709293:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2121676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.709568:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990592 00000100:00100000:2.0:1787864860.709573:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990592 00000100:00100000:2.0:1787864860.709656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787864860.709663:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8006:x1874712086990592:12345-0@lo:502: 00000100:00100000:2.0:1787864860.710513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8006:x1874712086990592:12345-0@lo:502: Request processed in 848us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.710523:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787864860.710621:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8006:1874712086990592:0@lo:502: 00000020:01000000:3.0:1787864860.710648:0:8006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864860.710655:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864860.710657:0:8006:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864860.710660:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787864860.712466:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787864860.712498:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787864860.712509:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.712520:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864860.712530:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864860.712545:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2100e4000 from 30 10000000:01000000:3.0:1787864860.712549:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864860.712586:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.712594:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.712604:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864860.712626:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990720:0@lo:101: 00000100:00100000:3.0:1787864860.712688:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.712733:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2121676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.712974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990720 00000100:00100000:1.0:1787864860.712981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990720 00000100:00100000:1.0:1787864860.713027:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787864860.713038:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712086990720:12345-0@lo:101: 00010000:00010000:1.0:1787864860.713055:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864860.713067:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.713089:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918bd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.713099:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918bd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.713106:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a400, rc 0) 00000100:00100000:1.0:1787864860.713144:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086990720:12345-0@lo:101: Request processed in 108us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.713151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787864860.715270:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990720:0@lo:101: 00010000:00010000:3.0:1787864860.715299:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.715323:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864860.715410:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990848:0@lo:501: 00000100:00100000:3.0:1787864860.715462:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864860.715506:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990848 00000100:00100000:3.0:1787864860.715508:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2121676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.715512:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990848 00000100:00100000:1.0:1787864860.715555:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787864860.715565:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086990848:12345-0@lo:501: 00000100:00100000:1.0:1787864860.715935:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086990848:12345-0@lo:501: Request processed in 371us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.715943:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787864860.716615:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990848:0@lo:501: 00000100:00100000:3.0:1787864860.716654:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990976:0@lo:503: 00000100:00100000:3.0:1787864860.716702:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.716738:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2121676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.716746:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086990976 00000100:00100000:1.0:1787864860.716751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086990976 00000100:00100000:2.0:1787864860.724507:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864860.724533:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086990976:12345-0@lo:503: 00000100:00100000:2.0:1787864860.724786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086990976:12345-0@lo:503: Request processed in 266us (8083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.724805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787864860.725054:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086990976:0@lo:503: 00000100:00100000:0.0:1787864860.727591:0:8007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8007:1874712086991104:0@lo:502: 00000100:00100000:0.0:1787864860.727670:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.727714:0:8007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.727738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991104 00000100:00100000:2.0:1787864860.727745:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991104 00000100:00100000:2.0:1787864860.727797:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864860.727805:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8007:x1874712086991104:12345-0@lo:502: 00000100:00100000:2.0:1787864860.728020:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8007:x1874712086991104:12345-0@lo:502: Request processed in 215us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.728027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787864860.728066:0:8007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8007:1874712086991104:0@lo:502: 00000100:00100000:0.0:1787864860.728109:0:8007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8007:1874712086991232:0@lo:502: 00000100:00100000:0.0:1787864860.728142:0:8007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.728164:0:8007:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.728199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991232 00000100:00100000:1.0:1787864860.728203:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991232 00000100:00100000:1.0:1787864860.728239:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787864860.728247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8007:x1874712086991232:12345-0@lo:502: 00000100:00100000:1.0:1787864860.728375:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8007:x1874712086991232:12345-0@lo:502: Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.728381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787864860.728417:0:8007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8007:1874712086991232:0@lo:502: 00000040:00080000:0.0:1787864860.728435:0:8007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787864860.728542:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787864860.728560:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787864860.728572:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.728582:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864860.728590:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787864860.728593:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2100e4000 from 5 10000000:01000000:1.0:1787864860.728596:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787864860.728620:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.728627:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.728635:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864860.728647:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991360:0@lo:101: 00000100:00100000:1.0:1787864860.728674:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864860.728700:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa1075e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.728747:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991360 00000100:00100000:2.0:1787864860.728751:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991360 00000100:00100000:2.0:1787864860.728776:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787864860.728782:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712086991360:12345-0@lo:101: 00010000:00010000:2.0:1787864860.728799:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864860.728810:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850400/0xa63eebe1861918d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.728829:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850400/0xa63eebe1861918d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918cb expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.728849:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850400/0xa63eebe1861918d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918cb expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.728859:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850400, rc 0) 00000100:00100000:2.0:1787864860.728892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712086991360:12345-0@lo:101: Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.728898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787864860.729029:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991360:0@lo:101: 00010000:00010000:0.0:1787864860.729040:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864860.729048:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864860.729088:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991488:0@lo:256: 00000100:00100000:0.0:1787864860.729119:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.729141:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.729242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991488 00000100:00100000:2.0:1787864860.729247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991488 00000100:00100000:2.0:1787864860.729275:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787864860.729281:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712086991488:12345-0@lo:256: 20000000:01000000:2.0:1787864860.729293:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787864860.729307:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787864860.729310:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787864860.729391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712086991488:12345-0@lo:256: Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864860.729421:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991488:0@lo:256: 00000100:00100000:2.0:1787864860.729423:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 10000000:01000000:0.0:1787864860.729460:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864860.729466:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864860.729473:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864860.729485:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787864860.729487:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787864860.729489:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864860.729505:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864860.729512:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864860.729519:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864860.729531:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991616:0@lo:101: 00000100:00100000:0.0:1787864860.729555:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.729587:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.730276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991616 00000100:00100000:1.0:1787864860.730282:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991616 00000100:00100000:1.0:1787864860.730309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787864860.730315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712086991616:12345-0@lo:101: 00010000:00010000:1.0:1787864860.730325:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864860.730339:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918d9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.730358:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.730367:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864860.730375:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a000, rc 0) 00000100:00100000:1.0:1787864860.730444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086991616:12345-0@lo:101: Request processed in 127us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.730450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787864860.730507:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991616:0@lo:101: 00010000:00010000:0.0:1787864860.730519:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864860.730528:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864860.730582:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991744:0@lo:501: 00000100:00100000:0.0:1787864860.730608:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.730639:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.731212:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991744 00000100:00100000:1.0:1787864860.731235:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991744 00000100:00100000:1.0:1787864860.731268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787864860.731276:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086991744:12345-0@lo:501: 00000100:00100000:1.0:1787864860.732343:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086991744:12345-0@lo:501: Request processed in 1064us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.732354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864860.732524:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991744:0@lo:501: 00000100:00100000:2.0:1787864860.732564:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991872:0@lo:503: 00000100:00100000:2.0:1787864860.732606:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.732644:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.735943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086991872 00000100:00100000:1.0:1787864860.735958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086991872 00000100:00100000:1.0:1787864860.736018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787864860.736027:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086991872:12345-0@lo:503: 00000100:00100000:1.0:1787864860.736476:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086991872:12345-0@lo:503: Request processed in 449us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.736484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:0.0:1787864860.740514:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864860.740590:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086991872:0@lo:503: 00000100:00100000:0.0:1787864860.741630:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8008:1874712086992000:0@lo:502: 00000100:00100000:0.0:1787864860.741715:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.741760:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446840 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.741852:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992000 00000100:00100000:1.0:1787864860.741859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992000 00000100:00100000:1.0:1787864860.741908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787864860.741917:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8008:x1874712086992000:12345-0@lo:502: 00000100:00100000:1.0:1787864860.742225:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8008:x1874712086992000:12345-0@lo:502: Request processed in 297us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.742233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787864860.742804:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8008:1874712086992000:0@lo:502: 00000020:01000000:0.0:1787864860.742836:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787864860.742844:0:8008:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787864860.742851:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864860.742853:0:8008:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787864860.742858:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787864860.742862:0:8008:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:0.0:1787864860.742884:0:8008:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787864860.742887:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864860.742911:0:8008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa22f98ced8) 00000020:00000080:0.0:1787864860.742932:0:8008:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787864860.742939:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787864860.743026:0:8008:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787864860.743033:0:8008:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787864860.743040:0:8008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861918ee 00010000:00080000:0.0:1787864860.743067:0:8008:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa23b54e800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787864860.743286:0:8008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787864860.743770:0:8008:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787864860.743783:0:8008:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787864860.744270:0:8008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864860.744665:0:8008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864860.744717:0:8008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787864860.744776:0:8008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787864860.745311:0:8009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864860.745317:0:8009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787864860.748050:0:8008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787864860.748065:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787864860.748097:0:8008:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787864860.748119:0:8008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe1861918f5 00000100:00080000:3.0:1787864860.748131:0:8008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864860.748136:0:8008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa23b54e800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787864860.748327:0:8008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa210d4d680 x1874712086992128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864860.748351:0:8008:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787864860.748436:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864860.748440:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864860.748442:0:8008:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787864860.748445:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864860.748448:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864860.748449:0:8008:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864860.748452:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864860.748453:0:8008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864860.748478:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8008:1874712086992384:0@lo:502: 00000100:00100000:2.0:1787864860.748503:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086992256:0@lo:400: 00000100:00100000:1.0:1787864860.748573:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712086992768:0@lo:400: 00000100:00100000:0.0:1787864860.748573:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712086992128:0@lo:8: 00000100:00100000:3.0:1787864860.754970:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.755046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992384 00000100:00100000:3.0:1787864860.755055:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992384 00000100:00100000:3.0:1787864860.755109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864860.755120:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8008:x1874712086992384:12345-0@lo:502: 00000100:00100000:2.0:1787864860.755493:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.755524:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8008:x1874712086992384:12345-0@lo:502: Request processed in 406us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864860.755531:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787864860.755544:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086992512:0@lo:400: 00000100:00100000:2.0:1787864860.755575:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.755579:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2121676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864860.755673:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8008:1874712086992384:0@lo:502: 00000020:01000000:3.0:1787864860.755703:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864860.755715:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864860.755718:0:8008:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864860.755722:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787864860.756203:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864860.756212:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086992640:0@lo:400: 00000100:00100000:2.0:1787864860.756252:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787864860.756295:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787864860.756337:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787864860.756347:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.756357:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864860.756366:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787864860.756369:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa210db4ed8 from 1 10000000:01000000:2.0:1787864860.756372:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1787864860.756497:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992640 00000100:00100000:3.0:1787864860.756502:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992640 00000100:00100000:1.0:1787864860.756519:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992256 00000100:00100000:1.0:1787864860.756523:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992256 00000100:00100000:3.0:1787864860.756543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864860.756543:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992512 00000100:00100000:1.0:1787864860.756545:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992512 00000100:00100000:3.0:1787864860.756551:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086992640:12345-0@lo:400: 00000100:00100000:1.0:1787864860.756556:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864860.756561:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086992256:12345-0@lo:400: 00000100:00100000:3.0:1787864860.756594:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086992640:12345-0@lo:400: Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.756594:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712086992256:12345-0@lo:400: Request processed in 33us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864860.756602:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864860.756602:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864860.756614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787864860.756619:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864860.756620:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086992512:12345-0@lo:400: 00010000:00080000:3.0:1787864860.756645:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c361c0 x1874712086992640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864860.756645:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712086992512:12345-0@lo:400: Request processed in 25us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.756650:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787864860.756656:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086992640:0@lo:400: 00010000:00080000:3.0:1787864860.756666:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c34f00 x1874712086992512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864860.756674:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712086992512:0@lo:400: 00010000:00080000:1.0:1787864860.756681:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c34780 x1874712086992256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864860.756698:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712086992256:0@lo:400: 00000100:00100000:1.0:1787864860.756724:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.756926:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992768 00000100:00100000:3.0:1787864860.756930:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992768 00000100:00100000:3.0:1787864860.756960:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787864860.756966:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712086992768:12345-0@lo:400: 00000100:00100000:3.0:1787864860.757018:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712086992768:12345-0@lo:400: Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864860.757024:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787864860.757036:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.757046:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787864860.757047:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c36940 x1874712086992768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864860.757056:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712086992768:0@lo:400: 00010000:00010000:2.0:1787864860.757057:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.757072:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086992896:0@lo:101: 00000100:00100000:2.0:1787864860.757102:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.757132:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864860.757139:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992896 00000100:00100000:3.0:1787864860.757142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992896 00000100:00100000:0.0:1787864860.758199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.758503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787864860.758515:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712086992896:12345-0@lo:101: 00010000:00010000:2.0:1787864860.758528:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864860.758542:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861918fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.758565:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861918fc expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.758576:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918fc expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.758584:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219851200, rc 0) 00000100:00100000:2.0:1787864860.758626:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712086992896:12345-0@lo:101: Request processed in 116us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864860.758633:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787864860.758671:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086992896:0@lo:101: 00010000:00010000:2.0:1787864860.758685:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864860.758694:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864860.758746:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086993024:0@lo:501: 00000100:00100000:2.0:1787864860.758769:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864860.758780:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864860.761453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993024 00000100:00100000:3.0:1787864860.761468:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993024 00000100:00100000:1.0:1787864860.761509:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086992128 00000100:00100000:1.0:1787864860.761514:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086992128 00000100:00100000:3.0:1787864860.761518:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864860.761527:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712086993024:12345-0@lo:501: 00000100:00100000:1.0:1787864860.761538:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864860.761542:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1874712086992128:12345-0@lo:8: 00010000:00080000:1.0:1787864860.761564:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1787864860.761591:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe18619190a 00002000:00100000:1.0:1787864860.761605:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa23b390800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787864860.761609:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787864860.761612:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787864860.761710:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787864860.761786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712086993024:12345-0@lo:501: Request processed in 260us (3015us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864860.761794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864860.761847:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086993024:0@lo:501: 00002000:00080000:1.0:1787864860.761850:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787864860.761874:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9fa23b395800 : changing import state from RECOVER to FULL 10000000:01000000:3.0:1787864860.761881:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787864860.761890:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864860.761899:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864860.761913:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874712086992128:12345-0@lo:8: Request processed in 369us (3717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.761920:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787864860.761956:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4d680 x1874712086992128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864860.761966:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864860.761973:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787864860.761981:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787864860.761986:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787864860.761988:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23b54e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787864860.762014:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787864860.762028:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712086992128:0@lo:8: 00000004:00080000:3.0:1787864860.762073:0:8009:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787864860.762162:0:8009:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176701764641ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787864860.847612:0:8010:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787864860.847646:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993280:0@lo:7: 00000100:00100000:0.0:1787864860.847715:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864860.847761:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b4469c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787864860.847863:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787864860.850544:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712086993152:0@lo:13: 00000100:00100000:1.0:1787864860.850612:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864860.850677:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993152 00000100:00100000:1.0:1787864860.850683:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993152 00000100:00100000:1.0:1787864860.850731:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864860.850739:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712086993152:12345-0@lo:13: 00002000:00000024:1.0:1787864860.850774:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787864860.850812:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712086993152:12345-0@lo:13: Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864860.850818:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787864860.850837:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787864860.850862:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1ccb40 x1874712086993152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864860.850879:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712086993152:0@lo:13: 00000100:00100000:0.0:1787864860.856531:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993280 00000100:00100000:0.0:1787864860.856619:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993280 00000100:00100000:0.0:1787864860.856702:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864860.856713:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8010:x1874712086993280:12345-0@lo:7: 00002000:00080000:0.0:1787864860.865956:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787864860.865965:0:6695:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787864860.866188:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8010:x1874712086993280:12345-0@lo:7: Request processed in 9474us (18468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864860.866200:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787864860.870702:0:8010:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cf480 x1874712086993280/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864860.870732:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993280:0@lo:7: 00000004:00080000:2.0:1787864860.870746:0:8010:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787864860.870786:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c37480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993408:0@lo:5: 00000100:00100000:2.0:1787864860.870844:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.870889:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993408 00000100:00100000:3.0:1787864860.870895:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993408 00000100:00100000:2.0:1787864860.870898:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864860.870948:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787864860.870958:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8010:x1874712086993408:12345-0@lo:5: 00002000:00080000:3.0:1787864860.870986:0:6694:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787864860.870990:0:6694:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787864860.873805:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8010:x1874712086993408:12345-0@lo:5: Request processed in 2842us (2954us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787864860.873818:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787864860.873857:0:8010:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c37480 x1874712086993408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864860.873874:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c37480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993408:0@lo:5: 00000004:00080000:3.0:1787864860.873896:0:8010:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787864860.873941:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993536:0@lo:700: 00000100:00100000:3.0:1787864860.873982:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864860.874019:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f07f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864860.874143:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993536 00000100:00100000:1.0:1787864860.874148:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993536 00000100:00100000:1.0:1787864860.874193:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864860.874202:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8010:x1874712086993536:12345-0@lo:700: 00000100:00100000:1.0:1787864860.874248:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874712086993664:0@lo:700: 00000100:00100000:1.0:1787864860.874279:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864860.874307:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864860.874428:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993664 00000100:00100000:2.0:1787864860.874433:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993664 00000100:00100000:2.0:1787864860.874465:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864860.874472:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874712086993664:12345-0@lo:700: 40000000:02000000:0.0:1787864860.936497:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787864860.951517:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874712086993664:12345-0@lo:700: Request processed in 77037us (77228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864860.951532:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787864860.951890:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f7e1e00 x1874712086993664/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787864876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864860.951906:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874712086993664:0@lo:700: 40000000:02000000:1.0:1787864860.951918:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1787864861.049061:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787864861.049076:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787864861.049247:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8010:x1874712086993536:12345-0@lo:700: Request processed in 175042us (175261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864861.049259:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787864861.049312:0:8010:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4cb40 x1874712086993536/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864861.049324:0:8010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787864861.049338:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993536:0@lo:700: 00000004:02000040:1.0:1787864861.112120:0:8010:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787864861.123501:0:8010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993792:0@lo:5: 00000100:00100000:1.0:1787864861.123566:0:8010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864861.123621:0:8010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787864861.123667:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993792 00000100:00100000:1.0:1787864861.123674:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993792 00000100:00100000:1.0:1787864861.123723:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864861.123732:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8010:x1874712086993792:12345-0@lo:5: 00002000:00080000:0.0:1787864861.141643:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787864861.141662:0:6695:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787864861.154906:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8010:x1874712086993792:12345-0@lo:5: Request processed in 31168us (31333us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787864861.154918:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787864861.155225:0:8010:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f7e1e00 x1874712086993792/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864861.155243:0:8010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8010:1874712086993792:0@lo:5: 00000004:00080000:2.0:1787864861.155257:0:8010:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787864861.761946:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864862.779752:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864863.739617:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086993920:0@lo:13: 00000100:00100000:3.0:1787864863.739683:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864863.739746:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086993920 00000100:00100000:0.0:1787864863.739753:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086993920 00000100:00100000:0.0:1787864863.739810:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864863.739819:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086993920:12345-0@lo:13: 00002000:00000024:0.0:1787864863.739852:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864863.742035:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086993920:12345-0@lo:13: Request processed in 222us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864863.742134:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787864863.742182:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864863.742386:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cda40 x1874712086993920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864863.743147:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086993920:0@lo:13: 00010000:00010000:3.0:1787864863.803575:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864864.827998:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787864864.910120:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787864865.392951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864865.393345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071241856 00000100:00100000:3.0:1787864865.393359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071241856 00000100:00100000:3.0:1787864865.393483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787864865.393494:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874712071241856:12345-192.168.206.10@tcp:250: 00010000:00080000:3.0:1787864865.393539:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b69f8bf5-21f5-49de-a2b8-58bf41e30d6a@192.168.206.10@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1787864865.393578:0:5844:0:(genops.c:1385:class_connect()) connect: client b69f8bf5-21f5-49de-a2b8-58bf41e30d6a, cookie 0xa63eebe186191911 00000100:00080000:3.0:1787864865.393780:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9fa203f0e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864865.393870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+5:2355:x1874712071241856:12345-192.168.206.10@tcp:250: Request processed in 375us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864865.393878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:0.0:1787864865.402125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864865.402929:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071241984 00000100:00100000:2.0:1787864865.402943:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071241984 00000100:00100000:2.0:1787864865.403214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:2.0:1787864865.403227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+5:5580:x1874712071241984:12345-192.168.206.10@tcp:101: 00010000:00010000:2.0:1787864865.403254:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864865.403278:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f77b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.403344:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.403360:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.403371:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219851c00, rc 0) 00000100:00100000:2.0:1787864865.403474:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+6:5580:x1874712071241984:12345-192.168.206.10@tcp:101: Request processed in 249us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864865.403482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:3.0:1787864865.408577:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864865.408660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242112 00000100:00100000:2.0:1787864865.408673:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242112 00000100:00100000:2.0:1787864865.408772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:2.0:1787864865.408783:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+6:5580:x1874712071242112:12345-192.168.206.10@tcp:501: 00000100:00100000:2.0:1787864865.409138:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+6:5580:x1874712071242112:12345-192.168.206.10@tcp:501: Request processed in 355us (573us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864865.409147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:3.0:1787864865.413691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.413759:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242240 00000100:00100000:0.0:1787864865.413772:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242240 00000100:00100000:0.0:1787864865.413836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:0.0:1787864865.413848:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+6:5580:x1874712071242240:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787864865.413878:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864865.413917:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f77c0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.413958:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.413973:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.413984:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2be00, rc 0) 00000100:00100000:0.0:1787864865.414234:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+7:5580:x1874712071242240:12345-192.168.206.10@tcp:101: Request processed in 387us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.414250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:1.0:1787864865.417878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864865.418269:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242368 00000100:00100000:2.0:1787864865.418281:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242368 00000100:00100000:2.0:1787864865.418380:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:2.0:1787864865.418393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+7:5580:x1874712071242368:12345-192.168.206.10@tcp:501: 00000100:00100000:2.0:1787864865.418895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5580:x1874712071242368:12345-192.168.206.10@tcp:501: Request processed in 501us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864865.418903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:3.0:1787864865.433149:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.434070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242496 00000100:00100000:0.0:1787864865.434085:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242496 00000100:00100000:0.0:1787864865.434215:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787864865.434227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5580:x1874712071242496:12345-192.168.206.10@tcp:503: 00000100:00100000:0.0:1787864865.434837:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5580:x1874712071242496:12345-192.168.206.10@tcp:503: Request processed in 609us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.434857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787864865.451208:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.451254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242624 00000100:00100000:0.0:1787864865.451266:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242624 00000100:00100000:0.0:1787864865.451318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:0.0:1787864865.451326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5599:x1874712071242624:12345-192.168.206.10@tcp:502: 00000100:00100000:0.0:1787864865.451680:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5599:x1874712071242624:12345-192.168.206.10@tcp:502: Request processed in 352us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.451690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:2.0:1787864865.479520:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864865.481126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242752 00000100:00100000:3.0:1787864865.481144:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242752 00000100:00100000:3.0:1787864865.481221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:3.0:1787864865.481233:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5599:x1874712071242752:12345-192.168.206.10@tcp:502: 00000100:00100000:3.0:1787864865.481609:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5599:x1874712071242752:12345-192.168.206.10@tcp:502: Request processed in 377us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864865.482016:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:3.0:1787864865.488954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.489009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071242880 00000100:00100000:0.0:1787864865.489022:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071242880 00000100:00100000:0.0:1787864865.490012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:0.0:1787864865.490025:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5580:x1874712071242880:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787864865.490554:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864865.490579:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2a800/0xa63eebe186191926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f77ea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.490620:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2a800/0xa63eebe186191926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77ea expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.490635:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2a800/0xa63eebe186191926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77ea expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864865.490646:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a800, rc 0) 00000100:00100000:0.0:1787864865.491364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5580:x1874712071242880:12345-192.168.206.10@tcp:101: Request processed in 1335us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.491375:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:0.0:1787864865.498927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864865.499099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243008 00000100:00100000:3.0:1787864865.499121:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243008 00000100:00100000:3.0:1787864865.499195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787864865.499208:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5580:x1874712071243008:12345-192.168.206.10@tcp:256: 20000000:01000000:3.0:1787864865.499241:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787864865.499267:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787864865.499272:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787864865.499275:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787864865.499277:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787864865.502336:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5580:x1874712071243008:12345-192.168.206.10@tcp:256: Request processed in 3114us (3408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.502354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787864865.510495:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864865.514819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243136 00000100:00100000:1.0:1787864865.514838:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243136 00000100:00100000:1.0:1787864865.514913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:1.0:1787864865.514925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5580:x1874712071243136:12345-192.168.206.10@tcp:101: 00010000:00010000:1.0:1787864865.514946:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864865.514968:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f77f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864865.515992:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864865.516035:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864865.519413:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ae00, rc 0) 00000100:00100000:1.0:1787864865.519973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5580:x1874712071243136:12345-192.168.206.10@tcp:101: Request processed in 5038us (9484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864865.519985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:3.0:1787864865.532365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.532434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243264 00000100:00100000:0.0:1787864865.532447:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243264 00000100:00100000:0.0:1787864865.532516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:0.0:1787864865.532529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5580:x1874712071243264:12345-192.168.206.10@tcp:501: 00000100:00100000:1.0:1787864865.533131:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5580:x1874712071243264:12345-192.168.206.10@tcp:501: Request processed in 600us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864865.533141:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:2.0:1787864865.541812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864865.541959:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243392 00000100:00100000:1.0:1787864865.541974:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243392 00000100:00100000:1.0:1787864865.542061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787864865.542072:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5580:x1874712071243392:12345-192.168.206.10@tcp:503: 00000100:00100000:1.0:1787864865.542603:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5580:x1874712071243392:12345-192.168.206.10@tcp:503: Request processed in 530us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864865.542896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:3.0:1787864865.552449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864865.552545:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243520 00000100:00100000:0.0:1787864865.552558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243520 00000100:00100000:0.0:1787864865.552634:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:0.0:1787864865.552647:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5603:x1874712071243520:12345-192.168.206.10@tcp:502: 00000100:00100000:0.0:1787864865.553001:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5603:x1874712071243520:12345-192.168.206.10@tcp:502: Request processed in 356us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.553011:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:0.0:1787864865.556793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864865.556857:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243648 00000100:00100000:1.0:1787864865.556872:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243648 00000100:00100000:1.0:1787864865.556940:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:1.0:1787864865.556954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5603:x1874712071243648:12345-192.168.206.10@tcp:502: 00000100:00100000:1.0:1787864865.557323:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5603:x1874712071243648:12345-192.168.206.10@tcp:502: Request processed in 371us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864865.557332:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:3.0:1787864865.562266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864865.562377:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243776 00000100:00100000:1.0:1787864865.562421:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243776 00000100:00100000:1.0:1787864865.562478:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787864865.562488:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874712071243776:12345-192.168.206.10@tcp:38: 00010000:00080000:1.0:1787864865.562531:0:5850:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1787864865.562588:0:5850:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe186191934 00000004:00100000:1.0:1787864865.562624:0:5850:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787864865.562632:0:5850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787864865.591561:0:5850:0:(import.c:65:import_set_state_nolock()) ffff9fa23b54a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864865.591670:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071243776:12345-192.168.206.10@tcp:38: Request processed in 29180us (29413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.591682:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787864865.792013:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086994048:0@lo:400: 00000100:00100000:0.0:1787864865.792295:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864865.792568:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864865.792576:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086994432:0@lo:400: 00000100:00100000:0.0:1787864865.792612:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864865.792656:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994048 00000100:00100000:0.0:1787864865.792693:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994048 00000100:00100000:0.0:1787864865.792760:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787864865.792771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712086994048:12345-0@lo:400: 00000100:00100000:0.0:1787864865.792844:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712086994048:12345-0@lo:400: Request processed in 74us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.792853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787864865.792910:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086994048:0@lo:400: 00000100:00100000:2.0:1787864865.793587:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994432 00000100:00100000:2.0:1787864865.793595:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994432 00000100:00100000:2.0:1787864865.793656:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864865.793665:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086994432:12345-0@lo:400: 00000100:00100000:2.0:1787864865.793725:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086994432:12345-0@lo:400: Request processed in 61us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864865.793732:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787864865.793771:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa21337a1c0 x1874712086994432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864865.793786:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086994432:0@lo:400: 00000100:00080000:0.0:1787864865.793893:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864865.794366:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712086994560:0@lo:400: 00000100:00100000:0.0:1787864865.794435:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864865.794486:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086994176:0@lo:400: 00000100:00100000:3.0:1787864865.794521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864865.794561:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086994688:0@lo:400: 00000100:00100000:3.0:1787864865.794588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864865.794634:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864865.794642:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086994304:0@lo:400: 00000100:00100000:0.0:1787864865.794659:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994560 00000100:00100000:0.0:1787864865.794665:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994560 00000100:00100000:3.0:1787864865.794689:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864865.794976:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994688 00000100:00100000:3.0:1787864865.794981:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994688 00000100:00100000:3.0:1787864865.795013:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787864865.795022:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086994688:12345-0@lo:400: 00000100:00100000:3.0:1787864865.795066:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086994688:12345-0@lo:400: Request processed in 45us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864865.795073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787864865.795104:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c0c70c0 x1874712086994688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864865.795112:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787864865.795127:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086994688:0@lo:400: 00000100:00100000:3.0:1787864865.796132:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994176 00000100:00100000:0.0:1787864865.796236:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994304 00000100:00100000:0.0:1787864865.796245:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994304 00000100:00100000:0.0:1787864865.796284:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864865.796294:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712086994560:12345-0@lo:400: 00000100:00100000:3.0:1787864865.796438:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994176 00000100:00100000:3.0:1787864865.796460:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787864865.796468:0:5850:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787864865.796599:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864865.796609:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086994304:12345-0@lo:400: 00000100:00100000:3.0:1787864865.796655:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086994304:12345-0@lo:400: Request processed in 49us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864865.796662:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864865.796680:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787864865.796687:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864865.796692:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086994176:12345-0@lo:400: 00000100:00100000:0.0:1787864865.796890:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712086994560:12345-0@lo:400: Request processed in 597us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864865.796898:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787864865.796923:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864865.796928:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787864865.796960:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa21337a1c0 x1874712086994560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864865.796975:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712086994560:0@lo:400: 00000100:00100000:3.0:1787864865.797063:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086994176:12345-0@lo:400: Request processed in 371us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864865.797071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787864865.798002:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa21337a940 x1874712086994304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864865.798017:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086994304:0@lo:400: 00010000:00080000:3.0:1787864865.798031:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4cb40 x1874712086994176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864865.798039:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086994176:0@lo:400: 00010000:00010000:3.0:1787864865.851583:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864866.299763:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712086994816:0@lo:13: 00000100:00100000:3.0:1787864866.299861:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864866.300343:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994816 00000100:00100000:1.0:1787864866.300358:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994816 00000100:00100000:1.0:1787864866.300550:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864866.300568:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712086994816:12345-0@lo:13: 00002000:00000024:1.0:1787864866.300619:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864866.300707:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712086994816:12345-0@lo:13: Request processed in 146us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864866.300716:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787864866.300775:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c37c00 x1874712086994816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864866.300803:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712086994816:0@lo:13: 00000100:00100000:2.0:1787864866.605893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864866.605970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864866.606046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244032 00000100:00100000:0.0:1787864866.606059:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244032 00000100:00100000:0.0:1787864866.606147:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071243904 00000100:00100000:0.0:1787864866.606163:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071243904 00000100:00100000:0.0:1787864866.606201:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787864866.606213:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:5580:x1874712071244032:12345-192.168.206.10@tcp:41: 00000004:00000024:0.0:1787864866.606280:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787864866.606362:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:5580:x1874712071244032:12345-192.168.206.10@tcp:41: Request processed in 152us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864866.606370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787864866.606432:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787864866.606440:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:0:x1874712071243904:12345-192.168.206.10@tcp:41: 00000004:00000024:0.0:1787864866.606450:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787864866.606472:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:0:x1874712071243904:12345-192.168.206.10@tcp:41: Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864866.606478:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00080000:2.0:1787864866.606891:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864866.609609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.609705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244160 00000100:00100000:3.0:1787864866.609718:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244160 00000100:00100000:3.0:1787864866.609791:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787864866.609803:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5580:x1874712071244160:12345-192.168.206.10@tcp:40: 00000100:00100000:3.0:1787864866.609993:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5580:x1874712071244160:12345-192.168.206.10@tcp:40: Request processed in 191us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864866.610002:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787864866.617803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.617855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.617945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.617995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.618074:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244672 00000100:00100000:3.0:1787864866.618087:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244672 00000100:00100000:3.0:1787864866.618167:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787864866.618180:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5580:x1874712071244672:12345-192.168.206.10@tcp:33: 00000100:00100000:2.0:1787864866.619128:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244288 00000100:00100000:2.0:1787864866.619137:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244288 00000100:00100000:2.0:1787864866.619173:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244416 00000100:00100000:2.0:1787864866.619176:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244416 00000100:00100000:2.0:1787864866.619210:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787864866.619217:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071244288:12345-192.168.206.10@tcp:8: 00010000:00080000:2.0:1787864866.619248:0:6696:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1787864866.619431:0:6696:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe18619193b 00002000:00100000:2.0:1787864866.619449:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ba0702c-0896-417b-a9c4-527e0244aed4/ffff9fa22f7c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787864866.619480:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787864866.620097:0:6696:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787864866.620140:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864866.620262:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071244288:12345-192.168.206.10@tcp:8: Request processed in 1043us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864866.620285:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787864866.620315:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787864866.620321:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071244416:12345-192.168.206.10@tcp:8: 00010000:00080000:2.0:1787864866.620345:0:6696:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1787864866.620373:0:6696:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe186191942 00002000:00100000:2.0:1787864866.620382:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ba0702c-0896-417b-a9c4-527e0244aed4/ffff9fa22f7c3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787864866.620390:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787864866.620680:0:6696:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787864866.621100:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864866.621204:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071244416:12345-192.168.206.10@tcp:8: Request processed in 877us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864866.621213:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787864866.625208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244544 00000100:00100000:1.0:1787864866.625226:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244544 00000100:00100000:1.0:1787864866.625414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:1.0:1787864866.625427:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071244544:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787864866.625529:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071244544:12345-192.168.206.10@tcp:400: Request processed in 104us (7672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864866.625537:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000004:00080000:3.0:1787864866.651788:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33487us 00000004:00200000:3.0:1787864866.671780:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787864866.672021:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5580:x1874712071244672:12345-192.168.206.10@tcp:33: Request processed in 53834us (54015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864866.672035:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00010000:00010000:0.0:1787864866.875879:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864866.890103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864866.890816:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244800 00000100:00100000:3.0:1787864866.890831:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244800 00000100:00100000:3.0:1787864866.890903:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787864866.890915:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21337a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5621:x1874712071244800:12345-192.168.206.10@tcp:101: 00010000:00010000:3.0:1787864866.890940:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864866.897467:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143c00/0xa63eebe186191949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f781b expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897555:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897570:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897587:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864866.897788:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787864866.897793:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864866.897874:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897920:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143c00/0xa63eebe186191949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f781b expref: 8 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897939:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f781b expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864866.897948:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dc900) 00010000:00010000:3.0:1787864866.897952:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864866.897955:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242143400, rc 0) 00000100:00100000:3.0:1787864866.898597:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21337a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:5621:x1874712071244800:12345-192.168.206.10@tcp:101: Request processed in 7679us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864866.898606:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:3.0:1787864867.899617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864868.859870:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864868.859900:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086994944:0@lo:13: 00000100:00100000:1.0:1787864868.859979:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864868.860099:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086994944 00000100:00100000:0.0:1787864868.860107:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086994944 00000100:00100000:0.0:1787864868.860193:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864868.860204:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086994944:12345-0@lo:13: 00002000:00000024:0.0:1787864868.860247:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864868.860305:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086994944:12345-0@lo:13: Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864868.860313:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787864868.860362:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa21337a1c0 x1874712086994944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864868.860435:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086994944:0@lo:13: 00000100:00080000:2.0:1787864868.860549:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787864868.923709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864868.971298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864868.971492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071244928 00000100:00100000:0.0:1787864868.971515:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071244928 00000100:00080000:2.0:1787864868.971598:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864868.971622:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787864868.971637:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:5673:x1874712071244928:12345-192.168.206.10@tcp:41: 00000004:00000024:0.0:1787864868.971697:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787864868.971794:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:5673:x1874712071244928:12345-192.168.206.10@tcp:41: Request processed in 159us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864868.971803:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787864868.978745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864868.978868:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245056 00000100:00100000:0.0:1787864868.978880:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245056 00000100:00100000:0.0:1787864868.978956:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787864868.978974:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5673:x1874712071245056:12345-192.168.206.10@tcp:13: 00002000:00000024:0.0:1787864868.979008:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864868.979085:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5673:x1874712071245056:12345-192.168.206.10@tcp:13: Request processed in 119us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864868.979093:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:2.0:1787864868.979976:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864868.984469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864868.984708:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245184 00000100:00100000:0.0:1787864868.984721:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245184 00000100:00100000:0.0:1787864868.984807:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787864868.984819:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5673:x1874712071245184:12345-192.168.206.10@tcp:13: 00002000:00000024:0.0:1787864868.984871:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864868.986294:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ba0702c-0896-417b-a9c4-527e0244aed4+6:5673:x1874712071245184:12345-192.168.206.10@tcp:13: Request processed in 148us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864868.986345:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:2.0:1787864868.988324:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787864869.425683:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00010000:00010000:3.0:1787864869.948372:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864870.912903:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086995072:0@lo:400: 00000100:00100000:0.0:1787864870.913133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086995200:0@lo:400: 00000100:00100000:0.0:1787864870.913208:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864870.913266:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086995712:0@lo:400: 00000100:00100000:0.0:1787864870.914193:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864870.914266:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864870.914790:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086995328:0@lo:400: 00000100:00100000:0.0:1787864870.917013:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995200 00000100:00100000:0.0:1787864870.917091:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995200 00000100:00100000:0.0:1787864870.917176:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864870.917746:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086995200:12345-0@lo:400: 00000100:00100000:0.0:1787864870.917874:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712086995200:12345-0@lo:400: Request processed in 133us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864870.917884:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864870.917926:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995712 00000100:00100000:0.0:1787864870.917931:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995712 00000100:00100000:0.0:1787864870.917976:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864870.917983:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086995712:12345-0@lo:400: 00000100:00100000:0.0:1787864870.918022:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086995712:12345-0@lo:400: Request processed in 39us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864870.918029:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864870.918293:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086995456:0@lo:400: 00000100:00100000:3.0:1787864870.918352:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787864870.918643:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864870.918662:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995456 00000100:00100000:0.0:1787864870.918785:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995456 00000100:00100000:0.0:1787864870.918936:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864870.918945:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086995456:12345-0@lo:400: 00000100:00100000:0.0:1787864870.918998:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712086995456:12345-0@lo:400: Request processed in 55us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864870.919005:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787864870.919028:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864870.919059:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864870.919202:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712086995584:0@lo:400: 00000100:00100000:0.0:1787864870.919241:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864870.919292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995072 00000100:00100000:0.0:1787864870.919297:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995072 00000100:00100000:0.0:1787864870.919336:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864870.919345:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712086995072:12345-0@lo:400: 00000100:00100000:0.0:1787864870.919392:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712086995072:12345-0@lo:400: Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864870.921633:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:3.0:1787864870.921889:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa0b40 x1874712086995456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864870.921911:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712086995456:0@lo:400: 00000100:00100000:0.0:1787864870.922274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995584 00000100:00100000:0.0:1787864870.922284:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995584 00000100:00100000:0.0:1787864870.922358:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864870.922453:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712086995584:12345-0@lo:400: 00000100:00100000:0.0:1787864870.922558:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712086995584:12345-0@lo:400: Request processed in 117us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864870.922566:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787864870.922600:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864870.922635:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21337a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086995072:0@lo:400: 00000100:00100000:0.0:1787864870.922654:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712086995584:0@lo:400: 00000100:00100000:3.0:1787864870.922682:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864870.926554:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995328 00000100:00100000:2.0:1787864870.926573:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995328 00000100:00100000:2.0:1787864870.926703:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864870.926716:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086995328:12345-0@lo:400: 00000100:00080000:0.0:1787864870.926773:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864870.926840:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712086995328:12345-0@lo:400: Request processed in 126us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864870.926848:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864870.926996:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712086995328:0@lo:400: 00000100:00100000:2.0:1787864870.927016:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712086995200:0@lo:400: 00010000:00080000:2.0:1787864870.927042:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa2d00 x1874712086995712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864870.927058:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086995712:0@lo:400: 00010000:00010000:3.0:1787864870.972227:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787864870.975335:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000001:00100000:3.0:1787864870.987772:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000100:00100000:3.0:1787864871.419884:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864871.430331:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086995840:0@lo:13: 00000100:00100000:3.0:1787864871.430481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864871.431845:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995840 00000100:00100000:1.0:1787864871.431862:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995840 00000100:00100000:1.0:1787864871.431984:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864871.431997:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086995840:12345-0@lo:13: 00002000:00000024:1.0:1787864871.432050:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864871.437322:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086995840:12345-0@lo:13: Request processed in 5316us (6829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864871.437340:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787864871.441667:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c36940 x1874712086995840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864871.441708:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086995840:0@lo:13: 00000001:02000400:0.0:1787864871.528863:0:8299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787864871.995648:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864872.101468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864872.101560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864872.101611:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864872.101656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864872.101728:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245568 00000100:00100000:1.0:1787864872.101741:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245568 00000100:00100000:0.0:1787864872.101753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245312 00000100:00100000:0.0:1787864872.101760:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245312 00000100:00100000:1.0:1787864872.101817:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245696 00000100:00100000:1.0:1787864872.101822:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245696 00000100:00100000:0.0:1787864872.101822:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:0.0:1787864872.101837:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2356:x1874712071245312:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787864872.101847:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787864872.101858:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071245568:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787864872.101876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245440 00000100:00100000:2.0:1787864872.101882:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245440 00000100:00100000:2.0:1787864872.101928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:2.0:1787864872.101938:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071245440:12345-192.168.206.10@tcp:400: 00000100:00080000:3.0:1787864872.101943:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864872.101949:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071245568:12345-192.168.206.10@tcp:400: Request processed in 91us (386us total) trans 0 rc 0/0 00000100:00080000:3.0:1787864872.101951:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864872.101956:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864872.101963:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787864872.101984:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787864872.101993:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071245696:12345-192.168.206.10@tcp:400: 00000100:00100000:0.0:1787864872.105861:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2356:x1874712071245312:12345-192.168.206.10@tcp:400: Request processed in 4009us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864872.105880:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:2.0:1787864872.106811:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071245440:12345-192.168.206.10@tcp:400: Request processed in 4867us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864872.106825:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:1.0:1787864872.109806:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071245696:12345-192.168.206.10@tcp:400: Request processed in 7799us (8133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864872.109824:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:3.0:1787864873.020577:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864873.979724:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864873.979758:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086995968:0@lo:13: 00000100:00100000:2.0:1787864873.979848:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864873.980174:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086995968 00000100:00100000:0.0:1787864873.980184:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086995968 00000100:00100000:0.0:1787864873.980271:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864873.980283:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086995968:12345-0@lo:13: 00002000:00000024:0.0:1787864873.980331:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864873.980388:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086995968:12345-0@lo:13: Request processed in 107us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864873.980429:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787864873.980535:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa03c0 x1874712086995968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864873.980558:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086995968:0@lo:13: 00000100:00080000:3.0:1787864873.980745:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787864874.043602:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864875.068501:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787864875.333483:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe113e76f0 20000000:00000080:3.0:1787864875.333499:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa106254000 uarg=0000000000000000 20000000:01000000:3.0:1787864875.333532:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787864875.333534:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787864875.333537:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787864875.333541:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787864875.333546:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787864875.333559:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787864875.333562:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787864875.333743:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787864875.333747:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787864875.347914:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787864875.348507:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787864875.348560:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787864875.348596:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787864875.348616:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787864875.348619:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787864875.349896:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787864875.350319:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787864875.350366:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787864875.350457:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787864875.350471:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787864875.350474:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787864875.356392:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787864875.357358:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787864875.357460:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787864875.357504:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787864875.357516:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787864875.357518:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787864875.360440:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787864875.360952:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787864875.361036:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787864875.361090:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1787864875.361107:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787864875.361127:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361158:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619184d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361166:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191877 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361173:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361179:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918af expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361185:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918bd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361192:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361199:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861918fc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361208:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361215:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361233:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361271:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361287:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.361302:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996096:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864875.361436:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361445:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.361454:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996224:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864875.361484:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361493:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 18 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.361502:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996352:0@lo:104: 00000100:00100000:1.0:1787864875.361539:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864875.361641:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.361661:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.361669:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996480:0@lo:104: 00000100:00100000:1.0:1787864875.361692:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864875.362207:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.362217:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 18 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.362226:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996608:0@lo:104: 00010000:00010000:1.0:1787864875.362248:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.362256:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 18 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.362263:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996736:0@lo:104: 00010000:00010000:1.0:1787864875.362278:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.362284:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 18 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.362292:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996864:0@lo:104: 00010000:00010000:1.0:1787864875.362307:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.362325:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.362333:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996992:0@lo:104: 00010000:00010000:1.0:1787864875.362351:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.362359:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 18 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.362366:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086997120:0@lo:104: 00000100:00100000:1.0:1787864875.362378:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864875.365653:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864875.365719:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864875.365744:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864875.365774:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864875.365788:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864875.365797:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864875.365807:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996352 00000100:00100000:2.0:1787864875.365815:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996352 00000100:00100000:2.0:1787864875.365856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996480 00000100:00100000:2.0:1787864875.365858:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996480 00000100:00100000:2.0:1787864875.365867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996608 00000100:00100000:2.0:1787864875.365869:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996608 00000100:00100000:2.0:1787864875.365878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996736 00000100:00100000:2.0:1787864875.365880:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996736 00000100:00100000:2.0:1787864875.365890:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996864 00000100:00100000:2.0:1787864875.365892:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996864 00000100:00100000:2.0:1787864875.365899:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086996992 00000100:00100000:2.0:1787864875.365901:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086996992 00000100:00100000:2.0:1787864875.365909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997120 00000100:00100000:2.0:1787864875.365911:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997120 00000100:00100000:2.0:1787864875.365921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864875.365930:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:8447:x1874712086996352:12345-0@lo:104: 00010000:00010000:2.0:1787864875.365945:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369074:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864875.369090:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+9:8447:x1874712086996352:12345-0@lo:104: Request processed in 3157us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369101:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864875.369149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864875.369161:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:8447:x1874712086996480:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369176:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369256:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864875.369261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+8:8447:x1874712086996480:12345-0@lo:104: Request processed in 105us (7569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864875.369301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864875.369327:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:8447:x1874712086996608:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369335:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369363:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787864875.369367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+7:8447:x1874712086996608:12345-0@lo:104: Request processed in 62us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864875.369386:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864875.369393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:8447:x1874712086996736:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369440:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369469:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787864875.369474:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+6:8447:x1874712086996736:12345-0@lo:104: Request processed in 83us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369479:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864875.369491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864875.369496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:8447:x1874712086996864:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369503:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369538:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787864875.369542:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:8447:x1874712086996864:12345-0@lo:104: Request processed in 47us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369548:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864875.369560:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864875.369565:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:8447:x1874712086996992:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369572:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369598:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787864875.369602:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:8447:x1874712086996992:12345-0@lo:104: Request processed in 38us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864875.369620:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864875.369626:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8447:x1874712086997120:12345-0@lo:104: 00010000:00010000:2.0:1787864875.369633:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.369656:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787864875.369660:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8447:x1874712086997120:12345-0@lo:104: Request processed in 35us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.369665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864875.370106:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1787864875.370123:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787864875.370129:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370150:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219850600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370154:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370163:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370170:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370176:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864875.370217:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370222:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996352:0@lo:104: 00010000:00010000:3.0:1787864875.370226:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787864875.370239:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996480:0@lo:104: 00010000:00010000:3.0:1787864875.370249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370251:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996608:0@lo:104: 00010000:00010000:3.0:1787864875.370263:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219850600/0xa63eebe1861918fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191903 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370264:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996736:0@lo:104: 00000100:00100000:0.0:1787864875.370276:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996864:0@lo:104: 00010000:00010000:3.0:1787864875.370285:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:0.0:1787864875.370287:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996992:0@lo:104: 00010000:00010000:3.0:1787864875.370297:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370306:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2a600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370309:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370312:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086997120:0@lo:104: 00010000:00010000:3.0:1787864875.370324:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370331:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370337:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864875.370355:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370361:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370387:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370415:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a600/0xa63eebe1861918d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370427:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787864875.370430:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370436:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242143600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370439:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370456:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370463:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370468:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864875.370484:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370490:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370498:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370505:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa242143600/0xa63eebe1861918bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370511:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997376:0@lo:103: 00010000:00010000:3.0:1787864875.370516:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787864875.370520:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370526:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219851800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370529:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370536:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370542:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370554:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787864875.370561:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864875.370575:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370582:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370589:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370596:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe1861918af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.370601:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787864875.370609:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787864875.370610:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997504:0@lo:103: 00010000:00010000:3.0:1787864875.370614:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370622:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219850800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370625:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370631:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370640:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370645:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787864875.370650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864875.370657:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370663:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370673:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370679:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe1861918a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861918a8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370688:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864875.370691:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370696:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219850c00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370698:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370703:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370709:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370715:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864875.370726:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370731:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370737:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370744:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219850c00/0xa63eebe186191877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe18619187e expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370751:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864875.370760:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370766:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864875.370768:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370775:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864875.370780:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864875.370785:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864875.370797:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370802:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864875.370807:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370813:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe18619184d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191854 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.370829:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864875.370832:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864875.370832:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997888:0@lo:103: 00010000:00010000:3.0:1787864875.370836:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864875.370846:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864875.370868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864875.370886:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864875.371567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997376 00000100:00100000:2.0:1787864875.371575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997376 00000100:00100000:3.0:1787864875.371645:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086997248:0@lo:103: 00000100:00100000:0.0:1787864875.371672:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086998016:0@lo:103: 00000100:00100000:3.0:1787864875.371691:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086997632:0@lo:103: 00000100:00100000:0.0:1787864875.371731:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996096:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864875.371746:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874712086996224:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864875.371747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997504 00000100:00100000:3.0:1787864875.371753:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997504 00010000:00010000:3.0:1787864875.371772:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 20 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.371793:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997888 00000100:00100000:3.0:1787864875.371796:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997888 00010000:00010000:0.0:1787864875.371800:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371809:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 21 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.371826:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864875.371835:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3315:x1874712086997504:12345-0@lo:103: 00010000:00010000:3.0:1787864875.371847:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864875.371852:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 21 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371861:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 21 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371878:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a400/0xa63eebe1861918c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861918bd expref: 21 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371890:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864875.371929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3315:x1874712086997504:12345-0@lo:103: Request processed in 95us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864875.371935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864875.371950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864875.371956:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712086997888:12345-0@lo:103: 00010000:00010000:3.0:1787864875.371963:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864875.371972:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371979:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371988:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242142600/0xa63eebe18619187e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191877 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.371997:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864875.372024:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712086997888:12345-0@lo:103: Request processed in 68us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864875.372030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787864875.375966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864875.376108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245824 00000100:00100000:3.0:1787864875.376117:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245824 00000100:00100000:0.0:1787864875.376156:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864875.376179:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 17 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864875.376223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998016 00000100:00100000:2.0:1787864875.376227:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998016 00000100:00100000:0.0:1787864875.376246:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997888:0@lo:103: 00010000:00010000:2.0:1787864875.376252:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 18 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.376261:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997504:0@lo:103: 00000100:00100000:2.0:1787864875.376269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864875.376278:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712086997376:12345-0@lo:103: 00010000:00010000:2.0:1787864875.376291:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864875.376296:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.376306:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.376312:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787864875.376320:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787864875.376324:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a000/0xa63eebe1861918e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861918d9 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.376337:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864875.376456:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712086997376:12345-0@lo:103: Request processed in 179us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.376463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864875.376481:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864875.376488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3315:x1874712086998016:12345-0@lo:103: 00010000:00010000:2.0:1787864875.376496:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864875.376500:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 16 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.376508:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 16 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.376526:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2b400/0xa63eebe186191854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe18619184d expref: 16 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.376534:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864875.376558:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:3315:x1874712086998016:12345-0@lo:103: Request processed in 71us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864875.376564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864875.376620:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864875.376696:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864875.376715:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086997760:0@lo:103: 00000100:00100000:1.0:1787864875.376749:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864875.376770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997632 00000100:00100000:1.0:1787864875.376774:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997632 00010000:00010000:1.0:1787864875.376793:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 15 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.376807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997248 00000100:00100000:1.0:1787864875.376810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997248 00010000:00010000:1.0:1787864875.376821:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 16 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.376831:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086997760 00000100:00100000:1.0:1787864875.376834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086997760 00010000:00010000:1.0:1787864875.376855:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 17 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.376870:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864875.376876:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3317:x1874712086997632:12345-0@lo:103: 00010000:00010000:1.0:1787864875.376884:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864875.376889:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 17 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.376897:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 17 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.376909:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a800/0xa63eebe1861918b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861918af expref: 17 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.376918:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864875.376955:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3317:x1874712086997632:12345-0@lo:103: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864875.376961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864875.376975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787864875.376983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:3318:x1874712086997248:12345-0@lo:103: 00010000:00010000:1.0:1787864875.376993:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864875.376998:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 10 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.376999:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 15 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.377020:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 15 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.377025:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787864875.377032:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219851200/0xa63eebe186191903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861918fc expref: 15 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.377036:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787864875.377058:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864875.377061:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3318:x1874712086997760:12345-0@lo:103: 00010000:00010000:3.0:1787864875.377071:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864875.377076:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 14 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377086:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 14 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.377094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3318:x1874712086997248:12345-0@lo:103: Request processed in 110us (395us total) trans 0 rc 0/0 00010000:00010000:3.0:1787864875.377101:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242142400/0xa63eebe1861918a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861918a1 expref: 14 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864875.377106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787864875.377122:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787864875.377127:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864875.377132:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787864875.377151:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071245824:12345-192.168.206.10@tcp:103: 00010000:00010000:1.0:1787864875.377161:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864875.377169:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 10 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.377170:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:3318:x1874712086997760:12345-0@lo:103: Request processed in 108us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864875.377186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787864875.377190:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 10 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864875.377371:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712086997632:0@lo:103: 00010000:00010000:1.0:1787864875.377485:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2be00/0xa63eebe18619191f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77c0 expref: 10 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864875.377498:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864875.377547:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:2358:x1874712071245824:12345-192.168.206.10@tcp:103: Request processed in 397us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864875.377555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787864875.377609:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864875.377611:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086997248:0@lo:103: 00000100:00100000:1.0:1787864875.377621:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712086997760:0@lo:103: 00000100:00100000:3.0:1787864875.377735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071245952 00000100:00100000:3.0:1787864875.377739:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071245952 00010000:00010000:3.0:1787864875.377756:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864875.377781:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787864875.377787:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:2358:x1874712071245952:12345-192.168.206.10@tcp:103: 00010000:00010000:3.0:1787864875.377794:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864875.377798:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377807:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377820:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219851c00/0xa63eebe186191918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77b9 expref: 9 pid: 5841 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377832:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377840:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377851:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377867:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377874:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377881:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377887:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336bc00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864875.377891:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377899:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377921:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864875.377933:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864875.377960:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:2358:x1874712071245952:12345-192.168.206.10@tcp:103: Request processed in 173us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864875.377967:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00010000:00010000:2.0:1787864875.385590:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.385609:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864875.385616:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336bc00/0xa63eebe186191957 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864875.388645:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086997376:0@lo:103: 00000100:00100000:0.0:1787864875.388679:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712086998016:0@lo:103: 00000100:00100000:2.0:1787864876.027747:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712086998528:0@lo:400: 00000100:00100000:0.0:1787864876.027748:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712086998272:0@lo:400: 00000100:00100000:2.0:1787864876.027853:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.027873:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086998400:0@lo:400: 00000100:00100000:0.0:1787864876.027953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.028031:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998528 00000100:00100000:2.0:1787864876.028039:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998528 00000100:00100000:2.0:1787864876.028110:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864876.028120:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712086998528:12345-0@lo:400: 00000100:00100000:2.0:1787864876.028190:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712086998528:12345-0@lo:400: Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.028197:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864876.028236:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.028278:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787864876.028286:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712086998144:0@lo:400: 00000100:00100000:2.0:1787864876.028322:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.028350:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086998656:0@lo:400: 00000100:00080000:3.0:1787864876.028373:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864876.028380:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.029494:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998272 00000100:00100000:0.0:1787864876.029506:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998272 00000100:00100000:0.0:1787864876.029743:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998144 00000100:00100000:0.0:1787864876.029748:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998144 00000100:00100000:0.0:1787864876.029773:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864876.029784:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712086998272:12345-0@lo:400: 00000100:00100000:0.0:1787864876.029872:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712086998272:12345-0@lo:400: Request processed in 89us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.029880:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864876.029898:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864876.029904:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712086998144:12345-0@lo:400: 00000100:00100000:0.0:1787864876.029932:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712086998144:12345-0@lo:400: Request processed in 29us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.029938:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787864876.032896:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998400 00000100:00100000:1.0:1787864876.032912:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998400 00000100:00100000:1.0:1787864876.033009:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998656 00000100:00100000:1.0:1787864876.033027:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998656 00000100:00100000:1.0:1787864876.033055:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864876.033203:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086998400:12345-0@lo:400: 00000100:00100000:1.0:1787864876.033298:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712086998400:12345-0@lo:400: Request processed in 235us (5350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.033306:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864876.033321:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864876.033327:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086998656:12345-0@lo:400: 00000100:00100000:1.0:1787864876.033361:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712086998656:12345-0@lo:400: Request processed in 33us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.033367:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864876.033467:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712086998528:0@lo:400: 00010000:00080000:2.0:1787864876.035260:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1d70c0 x1874712086998656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864876.035277:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712086998656:0@lo:400: 00000100:00100000:2.0:1787864876.035290:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712086998272:0@lo:400: 00000100:00100000:2.0:1787864876.035316:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712086998144:0@lo:400: 00000100:00080000:2.0:1787864876.035349:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864876.044096:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864876.044107:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787864876.055948:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c37480 x1874712086998400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864876.055972:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712086998400:0@lo:400: 00010000:00010000:3.0:1787864876.092551:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787864876.478274:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864876.478284:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa105678000 from 39 10000000:01000000:3.0:1787864876.478291:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864876.478355:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.478391:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.478424:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.478454:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086998784:0@lo:101: 00000100:00100000:3.0:1787864876.478545:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.478651:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.479514:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998784 00000100:00100000:0.0:1787864876.479527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998784 00000100:00100000:0.0:1787864876.479632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787864876.479643:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+12:5846:x1874712086998784:12345-0@lo:101: 00010000:00010000:0.0:1787864876.479662:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864876.479683:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2a200/0xa63eebe186191965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619195e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.479712:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2a200/0xa63eebe186191965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619195e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.479724:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2a200/0xa63eebe186191965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619195e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.479748:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a200, rc 0) 00000100:00100000:0.0:1787864876.479821:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086998784:12345-0@lo:101: Request processed in 181us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.479829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787864876.480861:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086998784:0@lo:101: 00010000:00010000:3.0:1787864876.480888:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.480900:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.480993:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086998912:0@lo:501: 00000100:00100000:3.0:1787864876.481047:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.481086:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.481489:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086998912 00000100:00100000:0.0:1787864876.481497:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086998912 00000100:00100000:0.0:1787864876.481633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787864876.481645:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086998912:12345-0@lo:501: 00000100:00100000:0.0:1787864876.482045:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086998912:12345-0@lo:501: Request processed in 402us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.482054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787864876.482155:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086998912:0@lo:501: 00000100:00100000:3.0:1787864876.482201:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999040:0@lo:503: 00000100:00100000:3.0:1787864876.482250:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.486494:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485000 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.493960:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999040 00000100:00100000:1.0:1787864876.493979:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999040 00000100:00100000:1.0:1787864876.494060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787864876.494071:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086999040:12345-0@lo:503: 00000100:00100000:1.0:1787864876.498002:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086999040:12345-0@lo:503: Request processed in 3919us (15738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.498019:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787864876.498221:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999040:0@lo:503: 00000100:00100000:1.0:1787864876.499176:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8467:1874712086999168:0@lo:502: 00000100:00100000:1.0:1787864876.499248:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.499298:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210074a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.499444:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999168 00000100:00100000:0.0:1787864876.499452:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999168 00000100:00100000:0.0:1787864876.499512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787864876.499523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:8467:x1874712086999168:12345-0@lo:502: 00000100:00100000:0.0:1787864876.499820:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:8467:x1874712086999168:12345-0@lo:502: Request processed in 297us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.499828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787864876.500169:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8467:1874712086999168:0@lo:502: 00000100:00100000:1.0:1787864876.500223:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8467:1874712086999296:0@lo:502: 00000100:00100000:1.0:1787864876.500267:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.500304:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210074a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.500417:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999296 00000100:00100000:0.0:1787864876.500422:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999296 00000100:00100000:0.0:1787864876.500468:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864876.500476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:8467:x1874712086999296:12345-0@lo:502: 00000100:00100000:0.0:1787864876.500880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:8467:x1874712086999296:12345-0@lo:502: Request processed in 403us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.500887:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787864876.501082:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8467:1874712086999296:0@lo:502: 00000040:00080000:3.0:1787864876.501190:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787864876.501389:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787864876.501441:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864876.501456:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.501476:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864876.501488:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787864876.501491:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787864876.501495:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787864876.501528:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.501548:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.501559:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864876.501576:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999424:0@lo:101: 00000100:00100000:2.0:1787864876.501846:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.501890:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.501963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999424 00000100:00100000:1.0:1787864876.501969:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999424 00000100:00100000:1.0:1787864876.502013:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787864876.502022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+13:5846:x1874712086999424:12345-0@lo:101: 00010000:00010000:1.0:1787864876.502034:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864876.502050:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a800/0xa63eebe186191973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619196c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.502078:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a800/0xa63eebe186191973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619196c expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.502090:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a800/0xa63eebe186191973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619196c expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.502100:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a800, rc 0) 00000100:00100000:1.0:1787864876.502215:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086999424:12345-0@lo:101: Request processed in 193us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.502223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787864876.502429:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999424:0@lo:101: 00010000:00010000:3.0:1787864876.502446:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.502457:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.502792:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999552:0@lo:501: 00000100:00100000:3.0:1787864876.502829:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.502853:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.502916:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999552 00000100:00100000:2.0:1787864876.502921:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999552 00000100:00100000:2.0:1787864876.502958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864876.502966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086999552:12345-0@lo:501: 00000100:00100000:2.0:1787864876.503877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086999552:12345-0@lo:501: Request processed in 908us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.503886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787864876.510928:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999552:0@lo:501: 00000100:00100000:3.0:1787864876.511016:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999680:0@lo:503: 00000100:00100000:3.0:1787864876.511116:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.511175:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.511318:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999680 00000100:00100000:0.0:1787864876.511325:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999680 00000100:00100000:0.0:1787864876.511393:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787864876.511426:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086999680:12345-0@lo:503: 00000100:00100000:0.0:1787864876.512159:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712086999680:12345-0@lo:503: Request processed in 732us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.512170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787864876.512611:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712086999680:0@lo:503: 00000100:00100000:3.0:1787864876.518033:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8468:1874712086999808:0@lo:502: 00000100:00100000:3.0:1787864876.518177:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.518281:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.518331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999808 00000100:00100000:2.0:1787864876.518340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999808 00000100:00100000:2.0:1787864876.518512:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787864876.518524:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8468:x1874712086999808:12345-0@lo:502: 00000100:00100000:2.0:1787864876.518862:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8468:x1874712086999808:12345-0@lo:502: Request processed in 340us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.518871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787864876.518984:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8468:1874712086999808:0@lo:502: 00000020:01000000:1.0:1787864876.519024:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864876.519036:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864876.519039:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787864876.519047:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787864876.519078:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8468:1874712086999936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.519120:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.519968:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210074b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.520066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712086999936 00000100:00100000:0.0:1787864876.520074:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712086999936 00000100:00100000:0.0:1787864876.520115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787864876.520124:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8468:x1874712086999936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.520370:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:8468:x1874712086999936:12345-0@lo:502:llog_process_th.0 Request processed in 246us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.520378:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787864876.520509:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8468:1874712086999936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864876.520545:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864876.520944:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864876.520948:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787864876.520956:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787864876.521190:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787864876.521212:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787864876.521225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.521237:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864876.521251:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787864876.521255:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa23be5b800 from 39 10000000:01000000:0.0:1787864876.521258:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864876.521298:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.521307:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.521331:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864876.521355:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.521458:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.522142:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.522262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000064 00000100:00100000:1.0:1787864876.522270:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000064 00000100:00100000:1.0:1787864876.522315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787864876.522324:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:5846:x1874712087000064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864876.522339:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864876.522359:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336b000/0xa63eebe186191981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe18619197a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.522390:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336b000/0xa63eebe186191981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe18619197a expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.522418:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336b000/0xa63eebe186191981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619197a expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.522429:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b000, rc 0) 00000100:00100000:1.0:1787864876.522824:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 498us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.522833:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787864876.523006:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864876.523028:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.523040:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864876.523118:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.523168:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.523198:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.523266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000192 00000100:00100000:2.0:1787864876.523273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000192 00000100:00100000:2.0:1787864876.523321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787864876.523329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.523893:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.523903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787864876.524020:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.524067:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.524113:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.524152:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.524360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000320 00000100:00100000:2.0:1787864876.524366:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000320 00000100:00100000:2.0:1787864876.524392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787864876.524437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.529389:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4940us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.529423:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787864876.529661:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864876.530785:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8469:1874712087000448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.530873:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.530926:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204c9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.530996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000448 00000100:00100000:2.0:1787864876.531004:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000448 00000100:00100000:2.0:1787864876.531056:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787864876.531067:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8469:x1874712087000448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864876.531370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8469:x1874712087000448:12345-0@lo:502:llog_process_th.0 Request processed in 304us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.531379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787864876.531840:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8469:1874712087000448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.531911:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8469:1874712087000576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.531962:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.531983:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.532067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000576 00000100:00100000:1.0:1787864876.532073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000576 00000100:00100000:1.0:1787864876.532103:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787864876.532119:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8469:x1874712087000576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.532322:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:8469:x1874712087000576:12345-0@lo:502:llog_process_th.0 Request processed in 205us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.532329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787864876.532487:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8469:1874712087000576:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787864876.532510:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787864876.533180:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787864876.533208:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864876.533220:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.533232:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864876.533257:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787864876.533260:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787864876.533263:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787864876.533294:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.533302:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.533311:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864876.533329:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.533369:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.533481:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864876.533762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000704 00000100:00100000:3.0:1787864876.533770:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000704 00000100:00100000:1.0:1787864876.535187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787864876.535212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+15:5846:x1874712087000704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864876.535232:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864876.535254:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336bc00/0xa63eebe18619198f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191988 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.535284:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336bc00/0xa63eebe18619198f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191988 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.535297:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336bc00/0xa63eebe18619198f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191988 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.535307:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336bc00, rc 0) 00000100:00100000:1.0:1787864876.535493:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087000704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.535500:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787864876.536226:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864876.536253:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.536265:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864876.536350:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.537883:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.537955:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.538022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000832 00000100:00100000:0.0:1787864876.538031:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000832 00000100:00100000:0.0:1787864876.538094:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787864876.538105:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087000832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.539039:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087000832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 932us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.539051:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864876.539158:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.539213:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864876.539267:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.539300:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.539345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087000960 00000100:00100000:0.0:1787864876.539350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087000960 00000100:00100000:0.0:1787864876.539383:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787864876.539409:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087000960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.540019:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087000960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 621us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.540027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787864876.540107:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087000960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.540891:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087001088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864876.540940:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.541016:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001088 00000100:00100000:1.0:1787864876.541023:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001088 00000100:00100000:1.0:1787864876.541073:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787864876.541082:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087001088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864876.541117:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864876.541171:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087001088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.541193:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787864876.541247:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20cb5f480 x1874712087001088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864876.541266:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087001088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864876.542160:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8470:1874712087001216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864876.542229:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.542273:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.542325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001216 00000100:00100000:1.0:1787864876.542331:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001216 00000100:00100000:1.0:1787864876.542425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787864876.542434:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8470:x1874712087001216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.542992:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8470:x1874712087001216:12345-0@lo:502:llog_process_th.0 Request processed in 557us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.543002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787864876.543107:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8470:1874712087001216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864876.543153:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864876.543166:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864876.543169:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787864876.543177:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787864876.543204:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8470:1874712087001344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864876.543241:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864876.543898:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864876.543975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001344 00000100:00100000:3.0:1787864876.543983:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001344 00000100:00100000:3.0:1787864876.544043:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787864876.544052:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8470:x1874712087001344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864876.544318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:8470:x1874712087001344:12345-0@lo:502:llog_process_th.0 Request processed in 266us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864876.544338:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787864876.544742:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8470:1874712087001344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864876.544779:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864876.544787:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864876.544789:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787864876.544797:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787864876.545024:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787864876.545044:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787864876.545056:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.545070:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864876.545081:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864876.545084:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2100e4000 from 39 10000000:01000000:3.0:1787864876.545088:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864876.545123:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.545140:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.545151:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.545173:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.545217:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.545290:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.545330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001472 00000100:00100000:1.0:1787864876.545336:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001472 00000100:00100000:1.0:1787864876.545503:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787864876.545513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087001472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864876.545528:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864876.545543:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a000/0xa63eebe18619199d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191996 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.545570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a000/0xa63eebe18619199d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191996 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.545592:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a000/0xa63eebe18619199d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191996 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864876.545749:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a000, rc 0) 00000100:00100000:1.0:1787864876.545807:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087001472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864876.545814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787864876.545886:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864876.545902:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.545924:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.545981:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.546007:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.546237:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.546307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001600 00000100:00100000:0.0:1787864876.546313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001600 00000100:00100000:0.0:1787864876.546339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787864876.546347:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087001600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.546879:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087001600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.546894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787864876.547040:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.547083:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.547127:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.547167:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.547213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001728 00000100:00100000:0.0:1787864876.547217:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001728 00000100:00100000:0.0:1787864876.547275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864876.547282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087001728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.547489:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087001728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.547496:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864876.547848:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087001728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.548271:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8471:1874712087001856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864876.548320:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.548382:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.548734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001856 00000100:00100000:1.0:1787864876.548741:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001856 00000100:00100000:0.0:1787864876.548879:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787864876.548890:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8471:x1874712087001856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.549196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8471:x1874712087001856:12345-0@lo:502:llog_process_th.0 Request processed in 306us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.549204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787864876.549298:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8471:1874712087001856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864876.549351:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8471:1874712087001984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864876.549388:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.549632:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.549907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087001984 00000100:00100000:0.0:1787864876.549913:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087001984 00000100:00100000:0.0:1787864876.549980:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787864876.549989:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8471:x1874712087001984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.550194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8471:x1874712087001984:12345-0@lo:502:llog_process_th.0 Request processed in 206us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.550201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787864876.550287:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8471:1874712087001984:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787864876.550314:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787864876.550707:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787864876.550728:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787864876.550740:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.550763:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864876.550775:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787864876.550778:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787864876.550781:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864876.550815:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.550824:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.550833:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864876.550854:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.550895:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.550927:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204c9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864876.550972:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002112 00000100:00100000:3.0:1787864876.550979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002112 00000100:00100000:3.0:1787864876.551006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787864876.551014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087002112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864876.551033:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864876.551048:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b350c00/0xa63eebe1861919ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861919a4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.551075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350c00/0xa63eebe1861919ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861919a4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.551087:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b350c00/0xa63eebe1861919ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919a4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.551099:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350c00, rc 0) 00000100:00100000:3.0:1787864876.553998:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2971us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864876.554013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787864876.554331:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864876.554365:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.554381:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864876.554846:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.554909:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.555001:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204c9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864876.555056:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002240 00000100:00100000:3.0:1787864876.555064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002240 00000100:00100000:3.0:1787864876.555150:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787864876.555160:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.555786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 625us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864876.555796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787864876.555869:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.555912:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.555959:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.556325:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204c9b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864876.556486:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002368 00000100:00100000:1.0:1787864876.556494:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002368 00000100:00100000:0.0:1787864876.556941:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787864876.556952:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.557230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.557243:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787864876.557329:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864876.558011:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8472:1874712087002496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.558064:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864876.558139:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208406a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.558180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002496 00000100:00100000:2.0:1787864876.558187:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002496 00000100:00100000:2.0:1787864876.558249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787864876.558258:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8472:x1874712087002496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864876.558519:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8472:x1874712087002496:12345-0@lo:502:llog_process_th.0 Request processed in 261us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.558526:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787864876.558622:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8472:1874712087002496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864876.558652:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864876.558663:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864876.558665:0:8472:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787864876.558671:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787864876.558691:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8472:1874712087002624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864876.558721:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.562069:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002624 00000100:00100000:3.0:1787864876.562086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002624 00000100:00100000:0.0:1787864876.562205:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.562305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787864876.562317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8472:x1874712087002624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864876.563080:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8472:x1874712087002624:12345-0@lo:502:llog_process_th.0 Request processed in 762us (4354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.563090:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787864876.563203:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8472:1874712087002624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864876.563247:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864876.563257:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864876.563260:0:8472:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787864876.563267:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787864876.563789:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787864876.563813:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787864876.563825:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.563837:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864876.563849:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787864876.563852:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa210db4ed8 from 1 10000000:01000000:0.0:1787864876.563866:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787864876.563903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.563913:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.563923:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864876.563948:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.563995:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864876.564217:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864876.564253:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002752 00000100:00100000:2.0:1787864876.564260:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002752 00000100:00100000:2.0:1787864876.564328:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787864876.564337:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087002752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864876.564349:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864876.564363:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850600/0xa63eebe1861919b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861919b2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.564386:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850600/0xa63eebe1861919b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861919b2 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.564430:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850600/0xa63eebe1861919b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919b2 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.564439:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850600, rc 0) 00000100:00100000:2.0:1787864876.564492:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087002752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.564499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787864876.564788:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864876.564805:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.564815:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864876.564893:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864876.564924:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864876.565062:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203485540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864876.565118:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087002880 00000100:00100000:0.0:1787864876.565123:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087002880 00000100:00100000:0.0:1787864876.565175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787864876.565183:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087002880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864876.565456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087002880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (531us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864876.565683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787864876.565800:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087002880:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787864876.565834:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787864876.565843:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864876.565852:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864876.641975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864876.642602:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246080 00000100:00100000:0.0:1787864876.642616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246080 00000100:00100000:0.0:1787864876.642690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:0.0:1787864876.642701:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:5595:x1874712071246080:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787864876.642723:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864876.642746:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2b400/0xa63eebe1861919c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7822 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.642782:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2b400/0xa63eebe1861919c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7822 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.642813:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2b400/0xa63eebe1861919c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7822 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864876.642825:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b400, rc 0) 00000100:00100000:0.0:1787864876.642966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246080:12345-192.168.206.10@tcp:101: Request processed in 266us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.642974:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:3.0:1787864876.654756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864876.654864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246208 00000100:00100000:0.0:1787864876.654879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246208 00000100:00100000:0.0:1787864876.654967:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:0.0:1787864876.654981:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246208:12345-192.168.206.10@tcp:501: 00000100:00100000:0.0:1787864876.655973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246208:12345-192.168.206.10@tcp:501: Request processed in 990us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.655986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:1.0:1787864876.660043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864876.660172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246336 00000100:00100000:2.0:1787864876.660185:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246336 00000100:00100000:2.0:1787864876.660252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:2.0:1787864876.660264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246336:12345-192.168.206.10@tcp:503: 00000100:00100000:2.0:1787864876.660945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246336:12345-192.168.206.10@tcp:503: Request processed in 680us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.660955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:3.0:1787864876.667866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864876.670272:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246464 00000100:00100000:2.0:1787864876.670291:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246464 00000100:00100000:2.0:1787864876.671756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:2.0:1787864876.671782:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:6067:x1874712071246464:12345-192.168.206.10@tcp:502: 00000100:00100000:2.0:1787864876.672895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:6067:x1874712071246464:12345-192.168.206.10@tcp:502: Request processed in 1116us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.672910:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:3.0:1787864876.677603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864876.677832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246592 00000100:00100000:0.0:1787864876.677844:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246592 00000100:00100000:0.0:1787864876.677918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:0.0:1787864876.677931:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:6067:x1874712071246592:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864876.678480:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:6067:x1874712071246592:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 549us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864876.678491:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:1.0:1787864876.681150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864876.681437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246720 00000100:00100000:2.0:1787864876.681449:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246720 00000100:00100000:2.0:1787864876.681521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:2.0:1787864876.681531:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071246720:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864876.681551:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864876.681574:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850000/0xa63eebe1861919c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7829 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.681716:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850000/0xa63eebe1861919c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7829 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.681731:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850000/0xa63eebe1861919c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7829 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864876.681742:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850000, rc 0) 00000100:00100000:2.0:1787864876.681809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071246720:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 279us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864876.681818:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:3.0:1787864876.686259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864876.686345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246848 00000100:00100000:0.0:1787864876.686357:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246848 00000100:00100000:0.0:1787864876.686472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:0.0:1787864876.686483:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071246848:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864876.687100:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071246848:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 615us (974us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864876.687120:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00010000:00010000:3.0:1787864877.116123:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864877.234907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864877.235667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864877.235785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864877.235829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864877.235896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071246976 00000100:00100000:2.0:1787864877.235910:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071246976 00000100:00100000:2.0:1787864877.235995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:2.0:1787864877.236007:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071246976:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864877.236116:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071246976:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864877.236137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:3.0:1787864877.236736:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247104 00000100:00100000:3.0:1787864877.236745:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247104 00000100:00100000:3.0:1787864877.236816:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787864877.236825:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071247104:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864877.236873:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071247104:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 49us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864877.236880:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00080000:2.0:1787864877.238522:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864877.242919:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247360 00000100:00100000:1.0:1787864877.242950:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247360 00000100:00100000:1.0:1787864877.243065:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247232 00000100:00100000:1.0:1787864877.243070:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247232 00000100:00080000:3.0:1787864877.243117:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864877.243122:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864877.243280:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787864877.243295:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071247360:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864877.243432:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071247360:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 141us (7768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864877.243441:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787864877.243473:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787864877.243480:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071247232:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864877.243508:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071247232:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (7679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864877.243514:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00010000:00010000:0.0:1787864878.140355:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787864878.727501:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4b3c1a20 20000000:00000080:1.0:1787864878.727530:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa22ef9b000 uarg=0000000000000000 20000000:01000000:1.0:1787864878.727581:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787864878.727588:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787864878.727594:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787864878.737569:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787864878.743567:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787864878.751687:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787864878.751739:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787864878.751789:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787864878.751809:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864878.751835:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751857:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191790 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751866:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe18619180e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751874:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751884:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751891:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751938:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.751955:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 9 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864878.751972:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003008:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864878.752134:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752161:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864878.752172:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003136:0@lo:104: 00000100:00100000:3.0:1787864878.752216:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864878.752259:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752267:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864878.752275:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003264:0@lo:104: 00000100:00100000:3.0:1787864878.752301:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864878.752361:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864878.752362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003136 00000100:00100000:3.0:1787864878.752376:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003264 00000100:00100000:2.0:1787864878.752378:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003136 00000100:00100000:3.0:1787864878.752387:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003264 00000100:00100000:3.0:1787864878.752475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864878.752486:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:8509:x1874712087003264:12345-0@lo:104: 00010000:00010000:3.0:1787864878.752500:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752547:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787864878.752553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc29c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:8509:x1874712087003264:12345-0@lo:104: Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864878.752560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864878.752583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864878.752590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8509:x1874712087003136:12345-0@lo:104: 00010000:00010000:3.0:1787864878.752609:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752651:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787864878.752659:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8509:x1874712087003136:12345-0@lo:104: Request processed in 68us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864878.752665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787864878.752716:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864878.752724:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.752725:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864878.752742:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787864878.752748:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752756:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864878.752764:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864878.752770:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787864878.752804:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752812:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864878.752837:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752844:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa200030600/0xa63eebe18619180e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191815 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752873:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864878.752875:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864878.752876:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864878.752925:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.752934:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 18 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864878.752943:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003520:0@lo:104: 00000100:00100000:3.0:1787864878.752967:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864878.752991:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864878.753018:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003136:0@lo:104: 00000100:00100000:2.0:1787864878.753020:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003520 00000100:00100000:2.0:1787864878.753029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003520 00000100:00100000:3.0:1787864878.753047:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003264:0@lo:104: 00000100:00100000:2.0:1787864878.753075:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787864878.753087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8509:x1874712087003520:12345-0@lo:104: 00010000:00010000:2.0:1787864878.753108:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864878.753292:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087003392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864878.753336:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864878.753389:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003392 00000100:00100000:1.0:1787864878.753424:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003392 00010000:00010000:2.0:1787864878.753426:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864878.753448:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753456:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 19 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.753476:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787864878.753482:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.753492:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864878.753493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 10000000:00010000:2.0:1787864878.753509:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864878.753511:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087003392:12345-0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1787864878.753528:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864878.753533:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864878.753543:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 19 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753555:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 19 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.753571:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753574:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa200031600/0xa63eebe186191815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe18619180e expref: 19 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.753592:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864878.753614:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753638:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864878.753669:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712087003392:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864878.753676:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864878.753713:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087003392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864878.753730:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864878.753736:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087003648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864878.753761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864878.753777:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191869 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191870 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864878.753789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003648 00000100:00100000:1.0:1787864878.753795:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003648 00010000:00010000:2.0:1787864878.753797:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864878.753802:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864878.753805:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864878.753813:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864878.753815:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.753818:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864878.753848:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864878.753855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3315:x1874712087003648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864878.753864:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864878.753868:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753877:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753887:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242143e00/0xa63eebe186191870 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191869 expref: 18 pid: 5842 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.753897:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864878.753921:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712087003648:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864878.753934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864878.753964:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087003648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864878.754056:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864878.754062:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:8509:x1874712087003520:12345-0@lo:104: Request processed in 978us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864878.754076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787864878.754096:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864878.754103:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754110:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864878.754114:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754131:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864878.754139:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864878.754145:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864878.754164:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754171:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864878.754189:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754196:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa200030800/0xa63eebe186191790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191797 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754219:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864878.754221:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864878.754223:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864878.754234:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087003776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864878.754260:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864878.754291:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003776 00000100:00100000:1.0:1787864878.754294:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003776 00010000:00010000:1.0:1787864878.754309:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 17 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864878.754326:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864878.754333:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3317:x1874712087003776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864878.754341:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864878.754345:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 17 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754353:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 17 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864878.754364:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864878.754389:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3317:x1874712087003776:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864878.754423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864878.754449:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087003776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864878.756163:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa242142000/0xa63eebe186191797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191790 expref: 16 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864878.756215:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003520:0@lo:104: 00000100:00100000:2.0:1787864878.764364:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1874712087003008:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864878.764444:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864878.789055:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864878.789153:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247488 00000100:00100000:2.0:1787864878.789163:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247488 00010000:00010000:2.0:1787864878.789213:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864878.789249:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:2.0:1787864878.789259:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071247488:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864878.789273:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864878.789279:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789291:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789309:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ae00/0xa63eebe18619192d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77f1 expref: 10 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789326:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789334:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789366:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789372:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789378:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789385:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789390:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864878.789438:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789448:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789466:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864878.789476:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864878.789524:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:2357:x1874712071247488:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 266us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864878.789532:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00010000:00010000:3.0:1787864878.789754:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.789763:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864878.789770:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b351a00/0xa63eebe1861919ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864879.104489:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864879.104515:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087003904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864879.104598:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864879.104837:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087003904 00000100:00100000:0.0:1787864879.104845:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087003904 00000100:00100000:0.0:1787864879.104916:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787864879.104926:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087003904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864879.104962:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864879.105008:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087003904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864879.105015:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787864879.105130:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864879.105172:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1d7c00 x1874712087003904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864879.105394:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087003904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864879.163846:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864880.187836:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864880.358258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864880.358352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247616 00000100:00100000:1.0:1787864880.358374:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247616 00000100:00100000:1.0:1787864880.358768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:1.0:1787864880.358781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:5595:x1874712071247616:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864880.358804:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864880.358831:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7830 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864880.358867:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864880.358883:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864880.358894:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ba00, rc 0) 00000100:00100000:1.0:1787864880.358973:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071247616:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 196us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864880.358982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:1.0:1787864880.366287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864880.369695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247744 00000100:00100000:2.0:1787864880.369721:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247744 00000100:00100000:2.0:1787864880.369803:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:2.0:1787864880.369825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071247744:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.370250:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071247744:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 426us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.370261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:3.0:1787864880.381026:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864880.387065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071247872 00000100:00100000:1.0:1787864880.387083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071247872 00000100:00100000:1.0:1787864880.387164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:1.0:1787864880.387177:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071247872:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864880.387495:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:5595:x1874712071247872:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 319us (6486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864880.387504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:1.0:1787864880.394157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864880.394300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248000 00000100:00100000:3.0:1787864880.394312:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248000 00000100:00100000:3.0:1787864880.394376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:3.0:1787864880.394387:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:6130:x1874712071248000:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864880.394931:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:6130:x1874712071248000:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 542us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864880.394941:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:0.0:1787864880.406383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864880.406836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248128 00000100:00100000:3.0:1787864880.406850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248128 00000100:00100000:3.0:1787864880.406914:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787864880.406925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:6130:x1874712071248128:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864880.407261:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:6130:x1874712071248128:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 337us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864880.407270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 174 10000000:01000000:3.0:1787864880.700391:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864880.700553:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105678000 from 4 10000000:01000000:3.0:1787864880.700561:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864880.700626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.700641:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.700679:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864880.700714:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864880.700805:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864880.700888:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.701382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004032 00000100:00100000:2.0:1787864880.701392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004032 00000100:00100000:2.0:1787864880.701692:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787864880.701704:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087004032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864880.701723:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864880.701743:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861919dc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.701774:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861919dc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.701785:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919dc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.701795:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219851200, rc 0) 00000100:00100000:2.0:1787864880.701858:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.701865:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787864880.702511:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864880.702536:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.702548:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864880.702631:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864880.702672:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864880.702754:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864880.707060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004160 00000100:00100000:1.0:1787864880.707080:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004160 00000100:00100000:1.0:1787864880.707661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787864880.707677:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864880.708561:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 883us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864880.708575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787864880.708622:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864880.708698:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864880.708759:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864880.718656:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787864880.720137:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004288 00000100:00100000:0.0:1787864880.720154:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004288 00000100:00100000:2.0:1787864880.720250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787864880.720267:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.724545:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4263us (15767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.724565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787864880.724871:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864880.725357:0:8591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8591:1874712087004416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864880.725464:0:8591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864880.725510:0:8591:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.725629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004416 00000100:00100000:2.0:1787864880.725637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004416 00000100:00100000:2.0:1787864880.725688:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787864880.725698:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8591:x1874712087004416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.725937:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8591:x1874712087004416:12345-0@lo:502:llog_process_th.0 Request processed in 239us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.725945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787864880.726097:0:8591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8591:1874712087004416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864880.726141:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864880.726154:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864880.726157:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787864880.726167:0:8591:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa105678000 00000020:00000080:1.0:1787864880.726170:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864880.726265:0:8591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8591:1874712087004544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864880.726306:0:8591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864880.726329:0:8591:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.728522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004544 00000100:00100000:2.0:1787864880.728540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004544 00000100:00100000:2.0:1787864880.728607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787864880.728619:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8591:x1874712087004544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.728933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:8591:x1874712087004544:12345-0@lo:502:llog_process_th.0 Request processed in 316us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.728942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787864880.729267:0:8591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8591:1874712087004544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864880.729313:0:8591:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864880.729323:0:8591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864880.729326:0:8591:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787864880.729332:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787864880.734827:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787864880.734878:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864880.734892:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.734907:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864880.734920:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787864880.734923:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23be5b800 from 4 10000000:01000000:2.0:1787864880.734927:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864880.735028:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.735037:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.735137:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864880.735172:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.735744:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.735804:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.735834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004672 00000100:00100000:2.0:1787864880.735841:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004672 00000100:00100000:2.0:1787864880.735900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787864880.735911:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087004672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864880.735928:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864880.735958:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861919ea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.735988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861919ea expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.736000:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919ea expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.736011:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850c00, rc 0) 00000100:00100000:2.0:1787864880.736070:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087004672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.736077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787864880.736146:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864880.736164:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.736184:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864880.736270:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.736308:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.737388:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa105619300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.737769:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004800 00000100:00100000:2.0:1787864880.737779:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004800 00000100:00100000:2.0:1787864880.737835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787864880.737846:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087004800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.738950:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087004800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1099us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.738964:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787864880.741055:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864880.741150:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864880.741238:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864880.741295:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b4546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.741551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087004928 00000100:00100000:2.0:1787864880.741560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087004928 00000100:00100000:2.0:1787864880.741622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787864880.741634:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087004928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.741876:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087004928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.741884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787864880.742650:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087004928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864880.743128:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8595:1874712087005056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864880.743196:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864880.743242:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.743312:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005056 00000100:00100000:2.0:1787864880.743319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005056 00000100:00100000:2.0:1787864880.743432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787864880.743452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8595:x1874712087005056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.743679:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8595:x1874712087005056:12345-0@lo:502:llog_process_th.0 Request processed in 238us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.743694:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787864880.745195:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8595:1874712087005056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864880.745246:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864880.745259:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864880.745262:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787864880.745271:0:8595:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa23be5b800 00000020:00000080:0.0:1787864880.745274:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787864880.745383:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8595:1874712087005184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864880.745499:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864880.745538:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005184 00000100:00100000:0.0:1787864880.745544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005184 00000100:00100000:0.0:1787864880.745582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787864880.745592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8595:x1874712087005184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864880.745825:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:8595:x1874712087005184:12345-0@lo:502:llog_process_th.0 Request processed in 233us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864880.745834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787864880.745890:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864880.745918:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8595:1874712087005184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864880.745941:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864880.745947:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864880.745949:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787864880.745953:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787864880.750515:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787864880.750560:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864880.750573:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.750603:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864880.750617:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864880.750620:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2100e4000 from 4 10000000:01000000:3.0:1787864880.750623:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864880.750673:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.750681:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864880.750694:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864880.750741:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864880.750831:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864880.750878:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d8e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.753473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005312 00000100:00100000:2.0:1787864880.753491:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005312 00000100:00100000:2.0:1787864880.753656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787864880.753671:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087005312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864880.753695:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864880.753718:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861919f8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.753754:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.753767:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.753777:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa219850e00, rc 0) 00000100:00100000:2.0:1787864880.753872:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087005312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.753881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787864880.753945:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864880.753978:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.753990:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864880.754077:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.754139:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.754651:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.754680:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005440 00000100:00100000:2.0:1787864880.754685:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005440 00000100:00100000:2.0:1787864880.754719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787864880.754727:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087005440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.755077:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087005440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.755085:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787864880.755125:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.755174:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.755219:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.755236:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa10547ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.755254:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005568 00000100:00100000:2.0:1787864880.755257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005568 00000100:00100000:2.0:1787864880.755274:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787864880.755280:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087005568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.755548:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087005568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.755556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787864880.755938:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864880.756249:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8596:1874712087005696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.756300:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.756907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005696 00000100:00100000:2.0:1787864880.756922:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005696 00000100:00100000:2.0:1787864880.756959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787864880.756969:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:8596:x1874712087005696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.757198:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:8596:x1874712087005696:12345-0@lo:502:llog_process_th.0 Request processed in 231us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.757206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787864880.757263:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.757283:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8596:1874712087005696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864880.757319:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864880.757344:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864880.757347:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787864880.757360:0:8596:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2100e4000 00000020:00000080:2.0:1787864880.757363:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787864880.758155:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8596:1874712087005824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.758274:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864880.758310:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005824 00000100:00100000:2.0:1787864880.758317:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005824 00000100:00100000:2.0:1787864880.758439:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787864880.758449:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:8596:x1874712087005824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864880.759530:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:8596:x1874712087005824:12345-0@lo:502:llog_process_th.0 Request processed in 1076us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864880.759545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787864880.762665:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20321c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864880.762723:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:8596:1874712087005824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864880.762779:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864880.762789:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864880.762798:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787864880.762810:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787864880.762913:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787864880.762935:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864880.762948:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864880.762961:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864881.153095:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087006080:0@lo:400:kworker.0 00000100:00100000:1.0:1787864881.153133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087005952:0@lo:400:kworker.0 00000100:00100000:3.0:1787864881.153235:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087006208:0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.157694:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864881.157808:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087006592:0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.157860:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864881.157924:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006080 00000100:00100000:0.0:1787864881.157933:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006080 00000100:00100000:0.0:1787864881.158008:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864881.158018:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087006080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.158082:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087006080:12345-0@lo:400:kworker.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864881.158091:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864881.158130:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006592 00000100:00100000:0.0:1787864881.158134:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006592 00000100:00100000:0.0:1787864881.158173:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864881.158180:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087006592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.158212:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087006592:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864881.158218:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787864881.158236:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864881.159386:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864881.159476:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087006464:0@lo:400:kworker.0 00000100:00100000:1.0:1787864881.159520:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864881.159569:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087006336:0@lo:400:kworker.0 00000100:00100000:1.0:1787864881.159599:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787864881.159658:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b76ad00 x1874712087006592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864881.159676:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087006592:0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.159693:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087006080:0@lo:400:kworker.0 00000100:00100000:3.0:1787864881.163978:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006464 00000100:00100000:3.0:1787864881.163990:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006464 00000100:00100000:3.0:1787864881.164048:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787864881.164059:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087006464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864881.164159:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087006464:12345-0@lo:400:kworker.0 Request processed in 102us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864881.164167:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787864881.164219:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087006464:0@lo:400:kworker.0 00000100:00100000:3.0:1787864881.164529:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787864881.168002:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864881.168039:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006208 00000100:00100000:0.0:1787864881.168053:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006208 00000100:00100000:0.0:1787864881.168149:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864881.168163:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087006208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864881.168288:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087006208:12345-0@lo:400:kworker.0 Request processed in 128us (3759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864881.168296:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787864881.168362:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864881.174136:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087005952 00000100:00100000:2.0:1787864881.174150:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087005952 00000100:00100000:2.0:1787864881.174228:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787864881.174243:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087005952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864881.174334:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087005952:12345-0@lo:400:kworker.0 Request processed in 97us (14953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864881.174343:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787864881.174426:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087005952:0@lo:400:kworker.0 00000100:00100000:2.0:1787864881.174506:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006336 00000100:00100000:2.0:1787864881.174513:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006336 00000100:00100000:2.0:1787864881.174563:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864881.174569:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087006336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864881.174607:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087006336:12345-0@lo:400:kworker.0 Request processed in 39us (15008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864881.174613:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787864881.174763:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864881.174843:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20cb5c000 x1874712087006336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864881.174858:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087006336:0@lo:400:kworker.0 00000100:00100000:1.0:1787864881.177541:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087006208:0@lo:400:kworker.0 00010000:00010000:1.0:1787864881.215907:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864881.660296:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087006720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864881.660390:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864881.660590:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006720 00000100:00100000:0.0:1787864881.660721:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006720 00000100:00100000:0.0:1787864881.660879:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864881.660891:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205894b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087006720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864881.660929:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864881.661078:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205894b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087006720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864881.661086:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787864881.663299:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b76b0c0 x1874712087006720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864881.663338:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087006720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787864882.237310:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864882.341640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864882.341691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864882.341730:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864882.341763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864882.341800:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248640 00000100:00100000:1.0:1787864882.341812:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248640 00000100:00100000:1.0:1787864882.341886:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248512 00000100:00100000:1.0:1787864882.341903:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248512 00000100:00100000:1.0:1787864882.342064:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787864882.342078:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071248640:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864882.342188:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071248640:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 113us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864882.342197:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787864882.342217:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787864882.342225:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071248512:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864882.342254:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071248512:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864882.342275:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00080000:1.0:1787864882.342301:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864882.342306:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864882.343238:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248384 00000100:00100000:2.0:1787864882.343255:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248384 00000100:00100000:2.0:1787864882.343317:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787864882.343328:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b7683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071248384:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864882.343385:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b7683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071248384:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 60us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864882.343392:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00080000:1.0:1787864882.344531:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864882.344632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248256 00000100:00100000:2.0:1787864882.344640:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248256 00000100:00100000:2.0:1787864882.344701:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:2.0:1787864882.344709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2356:x1874712071248256:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864882.344771:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2356:x1874712071248256:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 63us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864882.344779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 191 00010000:00010000:1.0:1787864883.259894:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864884.222625:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087006848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864884.222763:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864884.222835:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006848 00000100:00100000:0.0:1787864884.222844:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006848 00000100:00100000:0.0:1787864884.222914:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787864884.222915:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864884.222926:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087006848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864884.222960:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864884.223011:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087006848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864884.223018:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787864884.223059:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa1680 x1874712087006848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864884.223097:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087006848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864884.283573:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864884.865808:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787864885.307704:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864886.272109:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087007232:0@lo:400:kworker.0 00000100:00100000:0.0:1787864886.272178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864886.272243:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864886.272250:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007360:0@lo:400:kworker.0 00000100:00100000:0.0:1787864886.272281:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864886.272323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007232 00000100:00100000:0.0:1787864886.272332:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007232 00000100:00100000:0.0:1787864886.272391:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864886.272433:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864886.272486:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087007232:12345-0@lo:400:kworker.0 Request processed in 56us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864886.272507:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787864886.272530:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864886.272564:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087007232:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.272833:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087006976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.272870:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864886.272897:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087007488:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.272920:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864886.272939:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787864886.272945:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087007104:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.272963:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864886.272979:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087007616:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.273014:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864886.273043:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007360 00000100:00100000:1.0:1787864886.273046:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007360 00000100:00100000:1.0:1787864886.273090:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007616 00000100:00100000:1.0:1787864886.273093:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007616 00000100:00100000:1.0:1787864886.273110:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864886.273117:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.273151:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007360:12345-0@lo:400:kworker.0 Request processed in 35us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.273157:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864886.273169:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864886.273176:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087007616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.273220:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087007616:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.273226:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864886.273243:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087006976 00000100:00100000:1.0:1787864886.273246:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087006976 00000100:00100000:1.0:1787864886.273271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787864886.273277:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.273306:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087006976:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.273311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787864886.273338:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007488 00000100:00100000:1.0:1787864886.273341:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007488 00000100:00100000:1.0:1787864886.273364:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007104 00000100:00100000:1.0:1787864886.273367:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007104 00000100:00100000:1.0:1787864886.273384:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864886.273390:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087007488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.274182:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087007488:12345-0@lo:400:kworker.0 Request processed in 789us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.274190:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864886.274207:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864886.274214:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087007104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.274235:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087007104:12345-0@lo:400:kworker.0 Request processed in 23us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.274240:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787864886.274272:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864886.274276:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864886.274278:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864886.274313:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087007104:0@lo:400:kworker.0 00010000:00080000:1.0:1787864886.274325:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa1680 x1874712087007616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864886.274334:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087007616:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.274342:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087006976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864886.274349:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087007488:0@lo:400:kworker.0 00010000:00080000:1.0:1787864886.274661:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa2d00 x1874712087007360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864886.274672:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007360:0@lo:400:kworker.0 00010000:00010000:1.0:1787864886.333614:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864886.787786:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864886.787853:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864886.788166:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007744 00000100:00100000:1.0:1787864886.788173:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007744 00000100:00100000:1.0:1787864886.788222:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787864886.788232:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864886.788265:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864886.788358:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864886.788365:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787864886.797306:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b76a580 x1874712087007744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864886.797332:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864887.358723:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864887.461511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864887.461818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864887.461849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864887.461859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248768 00000100:00100000:1.0:1787864887.461868:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248768 00000100:00100000:2.0:1787864887.461886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864887.461912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:1.0:1787864887.461921:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071248768:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864887.462002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071248768:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 81us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864887.462016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:1.0:1787864887.462048:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071248896 00000100:00100000:1.0:1787864887.462051:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071248896 00000100:00100000:1.0:1787864887.462096:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787864887.462103:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071248896:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864887.462284:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249024 00000100:00100000:3.0:1787864887.462288:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249024 00000100:00100000:3.0:1787864887.462345:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249152 00000100:00100000:3.0:1787864887.462348:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249152 00000100:00100000:3.0:1787864887.462366:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787864887.462373:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071249024:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864887.462429:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071248896:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 326us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864887.462437:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787864887.462457:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787864887.462463:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1787864887.462475:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864887.462479:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864887.462481:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864887.462491:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787864887.462500:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787864887.462506:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071249152:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864887.472244:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071249024:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 9859us (10416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864887.472260:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787864887.480855:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071249152:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 18340us (18959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864887.480876:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00010000:00010000:2.0:1787864888.383050:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864889.342269:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864889.342290:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864889.342353:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864889.342482:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087007872 00000100:00100000:0.0:1787864889.342490:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087007872 00000100:00100000:0.0:1787864889.342561:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864889.342570:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864889.342604:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864889.342649:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087007872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864889.342656:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787864889.342697:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20cb5de00 x1874712087007872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864889.342713:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087007872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787864889.342834:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787864889.404080:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864889.816118:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing yml_node 00010000:00010000:1.0:1787864890.431152:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864891.388470:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087008128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.388540:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864891.388599:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087008640:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.388626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864891.388669:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087008384:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.388673:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787864891.388682:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087008000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.388710:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864891.388723:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864891.388736:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087008512:0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.388753:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864891.388761:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087008256:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.388765:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864891.388800:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864891.388805:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008640 00000100:00100000:3.0:1787864891.388813:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008640 00000100:00100000:1.0:1787864891.388834:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008128 00000100:00100000:1.0:1787864891.388840:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008128 00000100:00100000:3.0:1787864891.388865:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008384 00000100:00100000:3.0:1787864891.388870:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008384 00000100:00100000:1.0:1787864891.388874:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008512 00000100:00100000:1.0:1787864891.388878:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008512 00000100:00100000:3.0:1787864891.388901:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864891.388901:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008256 00000100:00100000:1.0:1787864891.388906:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008256 00000100:00100000:3.0:1787864891.388914:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087008640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.388925:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864891.388933:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.388979:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087008128:12345-0@lo:400:kworker.0 Request processed in 47us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864891.388986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864891.389000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864891.389006:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087008512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.389030:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087008512:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864891.389035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864891.389046:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864891.389063:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087008256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.389093:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087008256:12345-0@lo:400:kworker.0 Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864891.389099:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864891.389116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008000 00000100:00100000:1.0:1787864891.389119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008000 00000100:00100000:3.0:1787864891.389167:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087008640:12345-0@lo:400:kworker.0 Request processed in 255us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864891.389175:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864891.389181:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787864891.389191:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087008000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.389195:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864891.389207:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b7692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087008384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.389232:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087008000:12345-0@lo:400:kworker.0 Request processed in 42us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864891.389250:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787864891.389251:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b7692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087008384:12345-0@lo:400:kworker.0 Request processed in 42us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864891.389260:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864891.389348:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087008000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.389361:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087008512:0@lo:400:kworker.0 00000100:00100000:3.0:1787864891.389369:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087008128:0@lo:400:kworker.0 00000100:00080000:2.0:1787864891.389711:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864891.389716:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864891.389718:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787864891.390477:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa205897c00 x1874712087008640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864891.390496:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087008640:0@lo:400:kworker.0 00000100:00100000:1.0:1787864891.395651:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087008256:0@lo:400:kworker.0 00010000:00080000:1.0:1787864891.395672:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa205895680 x1874712087008384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864891.395843:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087008384:0@lo:400:kworker.0 00010000:00010000:2.0:1787864891.451592:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864891.899963:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087008768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864891.900037:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864891.900301:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008768 00000100:00100000:1.0:1787864891.900310:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008768 00000100:00100000:1.0:1787864891.900366:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864891.900375:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087008768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864891.900429:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864891.900487:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087008768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864891.900494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787864891.900571:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b76b480 x1874712087008768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864891.900588:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087008768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864892.475609:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864892.586587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864892.586629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864892.586664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864892.586758:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249408 00000100:00100000:0.0:1787864892.586767:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249408 00000100:00100000:0.0:1787864892.586831:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:0.0:1787864892.586840:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071249408:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864892.586907:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071249408:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 68us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864892.586915:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00080000:2.0:1787864892.587070:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864892.587125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249280 00000100:00100000:1.0:1787864892.587130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249280 00000100:00100000:1.0:1787864892.587169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:1.0:1787864892.587177:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071249280:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864892.587217:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071249280:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864892.587223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:3.0:1787864892.587582:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249536 00000100:00100000:3.0:1787864892.587587:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249536 00000100:00100000:3.0:1787864892.587676:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787864892.587684:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2355:x1874712071249536:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:3.0:1787864892.587712:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe18619193b 00000100:00080000:3.0:1787864892.587721:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7c6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787864892.587756:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787864892.588080:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+2:2355:x1874712071249536:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 395us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864892.588087:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:3.0:1787864892.588107:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864892.588219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00080000:0.0:1787864892.588334:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864892.589619:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249664 00000100:00100000:1.0:1787864892.589630:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249664 00000100:00100000:1.0:1787864892.589702:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787864892.589713:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2355:x1874712071249664:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:1.0:1787864892.589758:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191942 00000100:00080000:1.0:1787864892.589767:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7c2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787864892.589800:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787864892.590112:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+2:2355:x1874712071249664:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 400us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864892.590120:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00010000:00010000:2.0:1787864892.590234:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864892.590892:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787864893.505013:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864893.873384:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:0.0:1787864894.460502:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087008896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864894.460573:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.460812:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087008896 00000100:00100000:1.0:1787864894.460820:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087008896 00000100:00100000:1.0:1787864894.460882:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864894.460892:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087008896:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787864894.460987:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787864894.461056:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864894.461174:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087008896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 283us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864894.461182:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787864894.461446:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20cb5c3c0 x1874712087008896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864894.461466:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087008896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864894.524848:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787864895.001064:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:3.0:1787864895.001073:0:6719:0:(genops.c:885:class_export_put()) final put ffff9fa22f7c7800/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:0.0:1787864895.001154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f7c7800/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-OST0000 00000020:00000080:0.0:1787864895.001200:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa22f7c6800 for lustre-OST0000 00010000:00010000:2.0:1787864895.550035:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864896.206933:0:9343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:1.0:1787864896.510246:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087009152:0@lo:400:kworker.0 00000100:00100000:1.0:1787864896.510311:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864896.510657:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087009024:0@lo:400:kworker.0 00000100:00100000:1.0:1787864896.510697:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087009664:0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.510700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864896.510733:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087009536:0@lo:400:kworker.0 00000100:00100000:2.0:1787864896.510800:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009152 00000100:00100000:2.0:1787864896.510807:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009152 00000100:00100000:2.0:1787864896.510870:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787864896.510879:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087009152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516113:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087009280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516181:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864896.516220:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864896.516227:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087009408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516270:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864896.516317:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009280 00000100:00100000:0.0:1787864896.516323:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009280 00000100:00100000:0.0:1787864896.516368:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864896.516375:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087009280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516435:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087009280:12345-0@lo:400:kworker.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864896.516443:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864896.516537:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009408 00000100:00100000:0.0:1787864896.516541:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009408 00000100:00100000:0.0:1787864896.516568:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864896.516574:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087009408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516605:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087009408:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864896.516611:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787864896.516857:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864896.516862:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787864896.516889:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b768f00 x1874712087009408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864896.516903:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087009408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.516914:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087009280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.517259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864896.517290:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009536 00000100:00100000:0.0:1787864896.517295:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009536 00000100:00100000:0.0:1787864896.517317:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864896.517323:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087009536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864896.517358:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087009536:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864896.517365:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787864896.517378:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864896.517394:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087009536:0@lo:400:kworker.0 00000100:00100000:2.0:1787864896.517583:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087009152:12345-0@lo:400:kworker.0 Request processed in 6704us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864896.517592:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787864896.519351:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864896.519506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009024 00000100:00100000:1.0:1787864896.519515:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009024 00000100:00100000:1.0:1787864896.519558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787864896.519567:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864896.519631:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087009024:12345-0@lo:400:kworker.0 Request processed in 65us (8933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864896.519638:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787864896.519700:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009664 00000100:00100000:1.0:1787864896.519705:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009664 00000100:00100000:1.0:1787864896.519861:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864896.519871:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087009664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864896.519909:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087009664:12345-0@lo:400:kworker.0 Request processed in 41us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864896.519915:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787864896.519936:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864896.519986:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087009024:0@lo:400:kworker.0 00010000:00080000:1.0:1787864896.520138:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b769e00 x1874712087009664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864896.520154:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087009664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864896.520188:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087009152:0@lo:400:kworker.0 00000001:00100000:2.0:1787864896.540959:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:2.0:1787864896.540967:0:7645:0:(genops.c:885:class_export_put()) final put ffff9fa22f7c3800/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:0.0:1787864896.541066:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f7c3800/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-OST0001 00000020:00000080:0.0:1787864896.541275:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa22f7c2000 for lustre-OST0001 00010000:00010000:3.0:1787864896.571768:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864897.020519:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864897.020541:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087009792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864897.020612:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864897.020670:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009792 00000100:00100000:1.0:1787864897.020678:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009792 00000100:00100000:1.0:1787864897.020724:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864897.020732:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087009792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864897.020787:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864897.020830:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087009792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864897.020837:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787864897.020876:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b76b480 x1874712087009792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864897.020914:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087009792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864897.595736:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864897.702763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864897.703157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249792 00000100:00100000:1.0:1787864897.703171:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249792 00000100:00100000:3.0:1787864897.703302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:3.0:1787864897.703325:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071249792:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864897.703391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864897.703551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2357:x1874712071249792:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 235us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864897.703560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:0.0:1787864897.705903:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071249920 00000100:00100000:0.0:1787864897.705932:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071249920 00000100:00100000:0.0:1787864897.706006:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00080000:1.0:1787864897.706028:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864897.706028:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071249920:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864897.706127:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071249920:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 112us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864897.706137:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000001:02000400:0.0:1787864898.299854:0:9442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:2.0:1787864898.620045:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864899.509638:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 17:08:18 EDT 2026 00000100:00100000:3.0:1787864899.581649:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864899.581671:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087009920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864899.581744:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864899.581810:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087009920 00000100:00100000:3.0:1787864899.581817:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087009920 00000100:00100000:3.0:1787864899.581870:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787864899.581880:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087009920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864899.581914:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864899.581960:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087009920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864899.581966:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787864899.581986:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864899.582025:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2058970c0 x1874712087009920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864899.582043:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087009920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787864899.643533:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864900.669159:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864901.634040:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087010304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864901.634103:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864901.634153:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864901.634159:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087010432:0@lo:400:kworker.0 00000100:00100000:2.0:1787864901.634206:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864901.634242:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010432 00000100:00100000:2.0:1787864901.634249:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010432 00000100:00100000:2.0:1787864901.634299:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864901.634307:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b820780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087010432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864901.634353:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b820780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087010432:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864901.634360:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787864901.634378:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864901.634428:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f7e1680 x1874712087010432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864901.634442:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087010432:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638458:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087010176:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638540:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864901.638594:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087010688:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638622:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864901.638659:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787864901.638667:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087010048:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864901.638735:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087010560:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638757:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864901.638801:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010304 00000100:00100000:0.0:1787864901.638808:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010304 00000100:00100000:0.0:1787864901.638860:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010176 00000100:00100000:0.0:1787864901.638864:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010176 00000100:00100000:0.0:1787864901.638877:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010560 00000100:00100000:0.0:1787864901.638880:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010560 00000100:00100000:0.0:1787864901.638893:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787864901.638901:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087010304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.638967:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087010304:12345-0@lo:400:kworker.0 Request processed in 66us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864901.638987:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787864901.639017:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864901.639200:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.639238:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087010176:12345-0@lo:400:kworker.0 Request processed in 215us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864901.639245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864901.639259:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787864901.639265:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.639308:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087010560:12345-0@lo:400:kworker.0 Request processed in 43us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864901.639314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787864901.639415:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010688 00000100:00100000:0.0:1787864901.639419:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010688 00000100:00100000:0.0:1787864901.639451:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864901.639457:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.639491:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087010688:12345-0@lo:400:kworker.0 Request processed in 34us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864901.639497:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864901.639536:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087010560:0@lo:400:kworker.0 00000100:00100000:0.0:1787864901.639548:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087010176:0@lo:400:kworker.0 00010000:00080000:0.0:1787864901.639559:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa210d4cb40 x1874712087010688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864901.639570:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087010688:0@lo:400:kworker.0 00000100:00100000:3.0:1787864901.641456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010048 00000100:00100000:3.0:1787864901.641467:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010048 00000100:00100000:3.0:1787864901.641514:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787864901.641524:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864901.641595:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087010048:12345-0@lo:400:kworker.0 Request processed in 73us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864901.641602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787864901.641676:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087010048:0@lo:400:kworker.0 00000100:00080000:1.0:1787864901.641709:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864901.641715:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864901.641788:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087010304:0@lo:400:kworker.0 00010000:00010000:2.0:1787864901.691845:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864902.141856:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864902.141878:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087010816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864902.141945:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864902.142019:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010816 00000100:00100000:3.0:1787864902.142027:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010816 00000100:00100000:3.0:1787864902.142081:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787864902.142090:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087010816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864902.142125:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864902.142177:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087010816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864902.142184:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787864902.142226:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2058970c0 x1874712087010816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864902.142244:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087010816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787864902.715582:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864902.822111:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864902.822201:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864902.823247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250048 00000100:00100000:3.0:1787864902.823260:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250048 00000100:00100000:3.0:1787864902.823345:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:3.0:1787864902.823356:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071250048:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864902.823469:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071250048:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 115us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864902.823477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:0.0:1787864902.827120:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250176 00000100:00100000:0.0:1787864902.827140:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250176 00000100:00100000:0.0:1787864902.827255:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787864902.827266:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071250176:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864902.827350:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071250176:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 86us (5248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864902.827358:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00080000:2.0:1787864902.827484:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864903.740531:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864904.702301:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087010944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864904.702388:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864904.702527:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087010944 00000100:00100000:1.0:1787864904.702536:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087010944 00000100:00080000:3.0:1787864904.702607:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864904.702635:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864904.702649:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787864904.702652:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087010944:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864904.702666:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787864904.702705:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864904.702778:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087010944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864904.702786:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787864904.702843:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203ede580 x1874712087010944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864904.702868:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087010944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864904.764353:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864905.787659:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864906.749198:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011456:0@lo:400:kworker.0 00000100:00100000:3.0:1787864906.749309:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.749381:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864906.749388:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087011328:0@lo:400:kworker.0 00000100:00100000:3.0:1787864906.749437:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.749504:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011328 00000100:00100000:3.0:1787864906.749512:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011328 00000100:00100000:3.0:1787864906.749572:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787864906.749583:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087011328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864906.749636:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087011328:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.749643:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787864906.749668:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864906.749703:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087011328:0@lo:400:kworker.0 00000100:00100000:2.0:1787864906.750308:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011456 00000100:00100000:2.0:1787864906.750315:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011456 00000100:00100000:2.0:1787864906.750368:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864906.750377:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864906.750465:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011456:12345-0@lo:400:kworker.0 Request processed in 90us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.750472:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787864906.750491:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864906.750513:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2058943c0 x1874712087011456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864906.750525:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.750896:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087011200:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.750939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.750975:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f41f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087011712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751014:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.751049:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787864906.751057:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087011072:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751086:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.751124:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087011584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751147:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.751265:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011712 00000100:00100000:1.0:1787864906.751270:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011712 00000100:00100000:1.0:1787864906.751315:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864906.751324:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087011712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751368:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087011712:12345-0@lo:400:kworker.0 Request processed in 45us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.751375:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787864906.751443:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f41f0c0 x1874712087011712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864906.751453:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f41f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087011712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751506:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011200 00000100:00100000:1.0:1787864906.751510:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011200 00000100:00100000:1.0:1787864906.751538:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011584 00000100:00100000:1.0:1787864906.751541:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011584 00000100:00100000:1.0:1787864906.751559:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864906.751565:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087011200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751601:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087011200:12345-0@lo:400:kworker.0 Request processed in 35us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.751606:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864906.751617:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864906.751632:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087011584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751661:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087011584:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.751667:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864906.751692:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087011584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864906.751702:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087011200:0@lo:400:kworker.0 00000100:00080000:2.0:1787864906.752068:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864906.752073:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864906.753552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011072 00000100:00100000:2.0:1787864906.753563:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011072 00000100:00100000:2.0:1787864906.753633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787864906.753642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087011072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864906.753757:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087011072:12345-0@lo:400:kworker.0 Request processed in 115us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.753765:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787864906.754352:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087011072:0@lo:400:kworker.0 00010000:00010000:0.0:1787864906.812517:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864907.259625:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864907.259654:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f41c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864907.259744:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864907.259904:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011840 00000100:00100000:1.0:1787864907.259913:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011840 00000100:00100000:1.0:1787864907.259980:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864907.259991:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864907.260038:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864907.260094:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864907.260102:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787864907.260648:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f41c780 x1874712087011840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864907.260672:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f41c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787864907.836002:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864907.938106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864907.938190:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250304 00000100:00100000:3.0:1787864907.938200:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250304 00000100:00100000:3.0:1787864907.938258:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:3.0:1787864907.938269:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071250304:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864907.938354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071250304:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864907.938366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:3.0:1787864907.939090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864907.939173:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250432 00000100:00100000:0.0:1787864907.939179:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250432 00000100:00100000:0.0:1787864907.939311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787864907.939322:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071250432:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864907.939371:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071250432:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864907.939378:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00080000:2.0:1787864907.939501:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787864908.859637:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864909.819740:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864909.819807:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864909.820036:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087011968 00000100:00100000:1.0:1787864909.820044:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087011968 00000100:00100000:1.0:1787864909.820097:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864909.820105:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864909.820136:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864909.821489:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087011968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1378us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864909.821500:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787864909.821529:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864909.823214:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edde00 x1874712087011968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864909.823239:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087011968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864909.884639:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864910.907750:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864911.515684:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:08:30 (1787864910) === 00000100:00100000:1.0:1787864911.804970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864911.805232:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250560 00000100:00100000:3.0:1787864911.805242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250560 00000100:00100000:3.0:1787864911.805302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:3.0:1787864911.805314:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:8124:x1874712071250560:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787864911.805332:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864911.805351:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b350a00/0xa63eebe186191a06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7837 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.805380:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350a00/0xa63eebe186191a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7837 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.805392:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b350a00/0xa63eebe186191a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7837 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.805429:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350a00, rc 0) 00000100:00100000:3.0:1787864911.805496:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071250560:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 184us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.805503:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:0.0:1787864911.811087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.812807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250688 00000100:00100000:1.0:1787864911.812821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250688 00000100:00100000:1.0:1787864911.812889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:1.0:1787864911.812899:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071250688:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787864911.813571:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071250688:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 671us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.813581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:1.0:1787864911.820483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.820557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250816 00000100:00100000:0.0:1787864911.820574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250816 00000100:00100000:0.0:1787864911.820660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:0.0:1787864911.820672:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071250816:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787864911.822372:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071250816:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 1693us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.822387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:2.0:1787864911.831252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.831437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071250944 00000100:00100000:1.0:1787864911.831448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071250944 00000100:00100000:1.0:1787864911.831612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:1.0:1787864911.831625:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8128:x1874712071250944:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787864911.832040:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8128:x1874712071250944:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 416us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.832050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:2.0:1787864911.846652:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.846874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251072 00000100:00100000:0.0:1787864911.846887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251072 00000100:00100000:0.0:1787864911.846985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:0.0:1787864911.846997:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8128:x1874712071251072:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864911.847768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8128:x1874712071251072:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 769us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.847778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:2.0:1787864911.854159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.854284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251200 00000100:00100000:1.0:1787864911.854296:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251200 00000100:00100000:1.0:1787864911.854369:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:1.0:1787864911.854382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:8124:x1874712071251200:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787864911.854460:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864911.854486:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ae00/0xa63eebe186191a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7861 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.854523:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ae00/0xa63eebe186191a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7861 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.854536:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ae00/0xa63eebe186191a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7861 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.854573:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ae00, rc 0) 00000100:00100000:1.0:1787864911.854646:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:8124:x1874712071251200:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 267us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.854654:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:2.0:1787864911.861475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.861645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251328 00000100:00100000:0.0:1787864911.861657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251328 00000100:00100000:0.0:1787864911.861729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:0.0:1787864911.861741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:8124:x1874712071251328:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787864911.861775:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787864911.861806:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787864911.861811:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787864911.861815:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787864911.861817:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787864911.864613:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:8124:x1874712071251328:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 2860us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.864630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:3.0:1787864911.867865:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087012224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.867978:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.868062:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087012736:0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.868093:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.868129:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787864911.868135:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087012096:0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.868187:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.868222:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087012608:0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.868247:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864911.868423:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012224 00000100:00100000:0.0:1787864911.868432:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012224 00000100:00100000:0.0:1787864911.868483:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012608 00000100:00100000:0.0:1787864911.868486:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012608 00000100:00100000:0.0:1787864911.868517:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787864911.868527:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087012224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864911.868587:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087012224:12345-0@lo:400:kworker.0 Request processed in 61us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.868595:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787864911.868613:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787864911.868625:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087012608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864911.868653:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087012608:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.868658:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787864911.868705:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087012608:0@lo:400:kworker.0 00000100:00100000:0.0:1787864911.868716:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087012224:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.868924:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087012352:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.868990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864911.869027:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864911.869036:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012352 00000100:00100000:1.0:1787864911.869040:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012352 00000100:00100000:1.0:1787864911.869070:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864911.869077:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087012352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.869111:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087012352:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.869117:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787864911.869131:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864911.869148:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087012352:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.869184:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012096 00000100:00100000:1.0:1787864911.869188:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012096 00000100:00100000:2.0:1787864911.870429:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012736 00000100:00100000:2.0:1787864911.870457:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012736 00000100:00100000:2.0:1787864911.870520:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864911.870530:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087012736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.870748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787864911.870763:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087012096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.870815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087012096:12345-0@lo:400:kworker.0 Request processed in 57us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.870823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787864911.870828:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087012736:12345-0@lo:400:kworker.0 Request processed in 297us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.870838:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787864911.870921:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864911.870951:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087012096:0@lo:400:kworker.0 00010000:00080000:1.0:1787864911.870988:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edf840 x1874712087012736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864911.871002:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087012736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864911.872904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.873435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251456 00000100:00100000:0.0:1787864911.873445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251456 00000100:00100000:0.0:1787864911.873501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:0.0:1787864911.873512:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:8124:x1874712071251456:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787864911.873528:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864911.873548:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7868 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.873579:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.873591:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.873600:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b600, rc 0) 00000100:00100000:0.0:1787864911.873657:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8124:x1874712071251456:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 148us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.873676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:3.0:1787864911.876804:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087012480:0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.876899:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.876996:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012480 00000100:00100000:3.0:1787864911.877006:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012480 00000100:00100000:3.0:1787864911.877072:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864911.877083:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864911.877149:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087012480:12345-0@lo:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.877157:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787864911.877185:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864911.877231:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edde00 x1874712087012480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864911.877248:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787864911.877622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.877690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251584 00000100:00100000:1.0:1787864911.877695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251584 00000100:00100000:1.0:1787864911.877741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:1.0:1787864911.877750:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8124:x1874712071251584:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787864911.878096:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8124:x1874712071251584:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 346us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.878104:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:2.0:1787864911.879891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.879990:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251712 00000100:00100000:1.0:1787864911.880000:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251712 00000100:00100000:1.0:1787864911.880053:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:1.0:1787864911.880062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8124:x1874712071251712:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787864911.880610:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8124:x1874712071251712:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 546us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.880619:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787864911.884534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864911.884825:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251840 00000100:00100000:3.0:1787864911.884839:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251840 00000100:00100000:3.0:1787864911.884950:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:3.0:1787864911.884962:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8132:x1874712071251840:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864911.885268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8132:x1874712071251840:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 308us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.885373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:2.0:1787864911.889198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.889480:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071251968 00000100:00100000:1.0:1787864911.889492:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071251968 00000100:00100000:1.0:1787864911.889589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:1.0:1787864911.889601:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8132:x1874712071251968:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787864911.889929:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:8132:x1874712071251968:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 329us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.889948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:0.0:1787864911.892505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864911.892634:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252480 00000100:00100000:2.0:1787864911.892646:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252480 00000100:00100000:2.0:1787864911.892888:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787864911.892900:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071252480:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864911.893011:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071252480:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 112us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.893020:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00080000:3.0:1787864911.896570:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864911.896904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.897074:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252096 00000100:00100000:1.0:1787864911.897085:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252096 00000100:00100000:1.0:1787864911.897150:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787864911.897160:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2355:x1874712071252096:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787864911.897199:0:8208:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 259279c0-f351-4175-bf32-3107511ab0a0@192.168.206.10@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1787864911.897244:0:8208:0:(genops.c:1385:class_connect()) connect: client 259279c0-f351-4175-bf32-3107511ab0a0, cookie 0xa63eebe186191a1b 00000004:00100000:1.0:1787864911.897287:0:8208:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787864911.897638:0:8208:0:(import.c:65:import_set_state_nolock()) ffff9fa23b394000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787864911.897993:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+6:2355:x1874712071252096:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 832us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.898003:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787864911.903649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.904232:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252224 00000100:00100000:1.0:1787864911.904245:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252224 00000100:00100000:1.0:1787864911.904444:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787864911.904456:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:0:x1874712071252224:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787864911.904512:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787864911.904622:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:0:x1874712071252224:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 167us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.904631:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00080000:2.0:1787864911.904778:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864911.906054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864911.906127:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252352 00000100:00100000:3.0:1787864911.906158:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252352 00000100:00100000:3.0:1787864911.906207:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787864911.906223:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252352:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787864911.906247:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787864911.906315:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252352:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.906322:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787864911.908553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864911.908647:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252608 00000100:00100000:1.0:1787864911.908658:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252608 00000100:00100000:1.0:1787864911.908736:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787864911.908748:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252608:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787864911.908857:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252608:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.908866:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787864911.913088:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.913135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864911.913174:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864911.913374:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252992 00000100:00100000:3.0:1787864911.913387:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252992 00000100:00100000:3.0:1787864911.913486:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787864911.913497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252992:12345-192.168.206.10@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787864911.913927:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252736 00000100:00100000:1.0:1787864911.913932:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252736 00000100:00100000:1.0:1787864911.914013:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071252864 00000100:00100000:1.0:1787864911.914016:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071252864 00000004:00200000:3.0:1787864911.914129:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787864911.914304:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:259279c0-f351-4175-bf32-3107511ab0a0+6:8124:x1874712071252992:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 807us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.914313:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787864911.915360:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787864911.915371:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071252736:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787864911.915570:0:6696:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 259279c0-f351-4175-bf32-3107511ab0a0@192.168.206.10@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1787864911.915609:0:6696:0:(genops.c:1385:class_connect()) connect: client 259279c0-f351-4175-bf32-3107511ab0a0, cookie 0xa63eebe186191a22 00002000:00100000:0.0:1787864911.915625:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 259279c0-f351-4175-bf32-3107511ab0a0/ffff9fa203fd5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864911.915654:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787864911.915921:0:6696:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864911.916120:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864911.916191:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2355:x1874712071252736:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 820us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.916201:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787864911.916236:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787864911.916241:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071252864:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787864911.916262:0:6696:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 259279c0-f351-4175-bf32-3107511ab0a0@192.168.206.10@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1787864911.916291:0:6696:0:(genops.c:1385:class_connect()) connect: client 259279c0-f351-4175-bf32-3107511ab0a0, cookie 0xa63eebe186191a29 00002000:00100000:0.0:1787864911.916297:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 259279c0-f351-4175-bf32-3107511ab0a0/ffff9fa203fd0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864911.916312:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787864911.916458:0:6696:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787864911.916472:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864911.916510:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2355:x1874712071252864:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 268us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.916517:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00010000:00010000:1.0:1787864911.932465:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864912.379844:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f41cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087012864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864912.379963:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864912.380264:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012864 00000100:00100000:3.0:1787864912.380275:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012864 00000100:00100000:3.0:1787864912.380338:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864912.380348:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087012864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864912.380377:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864912.380460:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087012864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864912.380468:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787864912.380735:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f41cb40 x1874712087012864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864912.380756:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f41cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087012864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787864912.955997:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864913.979755:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864914.939689:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087012992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864914.939777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864914.939991:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087012992 00000100:00100000:0.0:1787864914.939999:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087012992 00000100:00080000:2.0:1787864914.940212:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864914.940258:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864914.940271:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087012992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864914.940318:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864914.940391:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087012992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864914.940426:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787864914.940506:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edd680 x1874712087012992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864914.940525:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087012992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864915.005669:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787864915.518996:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00010000:00010000:0.0:1787864916.027488:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864916.432193:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787864916.987538:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087013248:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.987582:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087013120:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.987636:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864916.987683:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087013632:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.987706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864916.987728:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864916.987733:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087013760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.987756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864916.987794:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087013376:0@lo:400:kworker.0 00000100:00100000:1.0:1787864916.987795:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864916.987828:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864916.987850:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087013504:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.987869:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013632 00000100:00100000:0.0:1787864916.987876:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013632 00000100:00100000:1.0:1787864916.987890:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864916.987943:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013760 00000100:00100000:1.0:1787864916.987948:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013760 00000100:00100000:3.0:1787864916.988034:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013120 00000100:00100000:3.0:1787864916.988047:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013120 00000100:00100000:1.0:1787864916.988139:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013504 00000100:00100000:1.0:1787864916.988146:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013504 00000100:00100000:1.0:1787864916.988185:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787864916.988196:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087013760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864916.988209:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787864916.988223:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087013120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864916.988256:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087013760:12345-0@lo:400:kworker.0 Request processed in 61us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864916.988266:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787864916.988288:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864916.988300:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087013504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864916.988321:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087013120:12345-0@lo:400:kworker.0 Request processed in 100us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864916.988331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787864916.988354:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087013504:12345-0@lo:400:kworker.0 Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864916.988372:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864916.988415:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013248 00000100:00100000:1.0:1787864916.988420:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013248 00000100:00100000:0.0:1787864916.988659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013376 00000100:00100000:0.0:1787864916.988665:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013376 00000100:00100000:1.0:1787864916.988753:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787864916.988765:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864916.988781:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787864916.988792:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787864916.988799:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087013248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.988806:0:5851:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787864916.988814:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087013632:12345-0@lo:400:kworker.0 Request processed in 51us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864916.988822:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864916.988875:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087013248:12345-0@lo:400:kworker.0 Request processed in 80us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864916.988886:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864916.988920:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787864916.988927:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b9dd2c0 x1874712087013760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864916.988933:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087013376:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787864916.988940:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864916.988948:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864916.988952:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864916.989128:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087013376:12345-0@lo:400:kworker.0 Request processed in 197us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864916.989152:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787864916.989194:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087013760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.989220:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087013120:0@lo:400:kworker.0 00000100:00100000:0.0:1787864916.989237:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087013632:0@lo:400:kworker.0 00010000:00080000:3.0:1787864916.989979:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edd680 x1874712087013504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864916.989997:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087013504:0@lo:400:kworker.0 00000100:00100000:3.0:1787864916.990074:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087013376:0@lo:400:kworker.0 00000100:00100000:3.0:1787864916.991959:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087013248:0@lo:400:kworker.0 00000001:00100000:0.0:1787864917.031505:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00000001:00100000:2.0:1787864917.047652:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00010000:00010000:1.0:1787864917.053037:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864917.158774:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864917.158814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864917.158843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864917.158875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864917.158897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864917.158955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253120 00000100:00100000:1.0:1787864917.158965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253120 00000100:00100000:2.0:1787864917.158983:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253632 00000100:00100000:2.0:1787864917.159006:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253632 00000100:00100000:2.0:1787864917.159055:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253504 00000100:00100000:1.0:1787864917.159065:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:2.0:1787864917.159070:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253504 00000100:00100000:3.0:1787864917.159073:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253376 00000100:00100000:3.0:1787864917.159077:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253376 00000100:00100000:1.0:1787864917.159087:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071253120:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864917.159098:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787864917.159103:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253248 00000100:00100000:3.0:1787864917.159106:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253248 00000100:00100000:2.0:1787864917.159106:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253632:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864917.159127:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:3.0:1787864917.159134:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253376:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864917.159170:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071253120:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.159179:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:2.0:1787864917.159515:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253632:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 408us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.159524:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787864917.159543:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787864917.159551:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253504:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864917.159576:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253504:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.159581:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00080000:2.0:1787864917.159598:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864917.159602:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864917.159605:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864917.161672:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787864917.161692:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071253248:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864917.161742:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071253376:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 2607us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864917.161751:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787864917.161753:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071253248:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 72us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.161758:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787864917.499516:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864917.499536:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864917.499601:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.499662:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087013888 00000100:00100000:2.0:1787864917.499668:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087013888 00000100:00100000:2.0:1787864917.499719:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864917.499728:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b820b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087013888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864917.499776:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864917.499820:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b820b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087013888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.499827:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787864917.500009:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b823480 x1874712087013888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864917.500027:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087013888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864918.079170:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.100294:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864920.060611:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087014016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864920.060733:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864920.060889:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014016 00000100:00100000:0.0:1787864920.060908:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014016 00000100:00100000:0.0:1787864920.060997:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864920.061008:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087014016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864920.061056:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864920.061109:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087014016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864920.061117:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787864920.063106:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864920.063186:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b9dc3c0 x1874712087014016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864920.063221:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087014016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864920.123626:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864921.148269:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864922.111126:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087014144:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111249:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087014656:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111278:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111306:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787864922.111312:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087014272:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111334:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111352:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087014784:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111420:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087014528:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111444:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111463:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864922.111469:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087014400:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864922.111517:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014656 00000100:00100000:0.0:1787864922.111525:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014656 00000100:00100000:3.0:1787864922.111566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014144 00000100:00100000:3.0:1787864922.111571:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014144 00000100:00100000:0.0:1787864922.111575:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014272 00000100:00100000:0.0:1787864922.111577:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014272 00000100:00100000:0.0:1787864922.111591:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014400 00000100:00100000:0.0:1787864922.111594:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014400 00000100:00100000:3.0:1787864922.111598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787864922.111606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087014144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.111606:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787864922.111611:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087014656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864922.111652:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087014144:12345-0@lo:400:kworker.0 Request processed in 47us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864922.111660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787864922.111693:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787864922.111710:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.113248:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014784 00000100:00100000:1.0:1787864922.113260:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014784 00000100:00100000:2.0:1787864922.113317:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014528 00000100:00100000:2.0:1787864922.113321:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014528 00000100:00100000:2.0:1787864922.113364:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787864922.113373:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.113378:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864922.113384:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087014528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.113761:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087014528:12345-0@lo:400:kworker.0 Request processed in 376us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864922.113768:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864922.113798:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864922.113806:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087014400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.113841:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087014400:12345-0@lo:400:kworker.0 Request processed in 36us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864922.113847:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787864922.113906:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864922.113911:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864922.113914:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864922.113967:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087014400:0@lo:400:kworker.0 00010000:00080000:1.0:1787864922.113980:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b9de940 x1874712087014528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864922.113989:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787864922.115157:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087014784:12345-0@lo:400:kworker.0 Request processed in 1782us (3775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864922.115167:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864922.115484:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087014272:12345-0@lo:400:kworker.0 Request processed in 3782us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864922.115493:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787864922.115908:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087014272:0@lo:400:kworker.0 00010000:00080000:1.0:1787864922.115937:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b9de580 x1874712087014784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864922.116023:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087014784:0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.116037:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087014144:0@lo:400:kworker.0 00000100:00100000:1.0:1787864922.116109:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087014656:0@lo:400:kworker.0 00000100:00100000:0.0:1787864922.116113:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087014656:12345-0@lo:400:kworker.0 Request processed in 4500us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864922.116120:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1787864922.172826:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864922.276813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864922.276862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864922.276912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864922.276941:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864922.276979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864922.277008:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254016 00000100:00100000:2.0:1787864922.277017:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254016 00000100:00100000:2.0:1787864922.277075:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253888 00000100:00100000:2.0:1787864922.277079:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253888 00000100:00100000:2.0:1787864922.277101:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787864922.277110:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254016:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864922.277197:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254016:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864922.277204:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787864922.277221:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:2.0:1787864922.277228:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071253888:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864922.277253:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071253888:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864922.277259:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787864922.277261:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254272 00000100:00100000:0.0:1787864922.277267:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254272 00000100:00100000:2.0:1787864922.277282:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254144 00000100:00100000:2.0:1787864922.277288:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254144 00000100:00100000:0.0:1787864922.277312:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787864922.277325:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:0.0:1787864922.277326:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254272:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864922.277338:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254144:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864922.277373:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254272:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 52us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864922.277377:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071254144:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864922.277390:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787864922.277450:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071253760 00000100:00100000:1.0:1787864922.277455:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071253760 00000100:00100000:1.0:1787864922.277485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:1.0:1787864922.277493:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071253760:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864922.277520:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071253760:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864922.277526:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00080000:3.0:1787864922.277784:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864922.277802:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864922.277805:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864922.286893:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787864922.624117:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087014912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864922.624201:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864922.625931:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087014912 00000100:00100000:1.0:1787864922.625944:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087014912 00000100:00100000:1.0:1787864922.625994:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864922.626004:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087014912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864922.626042:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864922.626116:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087014912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864922.626125:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787864922.626269:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edf840 x1874712087014912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864922.626291:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087014912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787864923.199648:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864924.219553:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864925.179712:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087015040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864925.179781:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864925.184158:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015040 00000100:00100000:0.0:1787864925.184170:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015040 00000100:00100000:0.0:1787864925.184283:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864925.184294:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087015040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864925.184339:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864925.184435:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087015040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864925.184443:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787864925.185357:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edde00 x1874712087015040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864925.185380:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087015040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864925.185586:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787864925.243551:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864926.274076:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864927.228589:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087015168:0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.228653:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864927.228697:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087015680:0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.228723:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864927.228761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015168 00000100:00100000:0.0:1787864927.228767:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015168 00000100:00100000:3.0:1787864927.228803:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087015296:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.228835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864927.228866:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087015808:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.228891:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864927.228919:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087015424:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.228942:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864927.228967:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864927.228967:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787864927.228976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087015168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.229025:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087015168:12345-0@lo:400:kworker.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864927.229032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787864927.229073:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015680 00000100:00100000:0.0:1787864927.229077:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015680 00000100:00100000:0.0:1787864927.229105:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015296 00000100:00100000:0.0:1787864927.229108:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015296 00000100:00100000:0.0:1787864927.229130:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015424 00000100:00100000:0.0:1787864927.229132:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015424 00000100:00100000:0.0:1787864927.229146:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787864927.229151:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087015680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.229182:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087015680:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864927.229203:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787864927.229216:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864927.229221:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087015296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.229251:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087015296:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864927.229257:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864927.229269:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864927.229274:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087015424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.229299:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087015424:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864927.229317:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864927.229352:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087015168:0@lo:400:kworker.0 00000100:00100000:0.0:1787864927.229365:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087015680:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.229737:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087015552:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.229769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864927.229795:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087015424:0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.230085:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015808 00000100:00100000:3.0:1787864927.230090:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015808 00000100:00100000:3.0:1787864927.230124:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015552 00000100:00100000:3.0:1787864927.230127:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015552 00000100:00100000:3.0:1787864927.230149:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864927.230159:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087015808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.230421:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087015808:12345-0@lo:400:kworker.0 Request processed in 264us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864927.230428:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864927.230444:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787864927.230451:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087015552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864927.230485:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087015552:12345-0@lo:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864927.230491:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787864927.230637:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864927.230641:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864927.230643:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864927.230936:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087015296:0@lo:400:kworker.0 00010000:00080000:3.0:1787864927.230949:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353e1c0 x1874712087015808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864927.230959:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087015808:0@lo:400:kworker.0 00010000:00080000:3.0:1787864927.231017:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203edda40 x1874712087015552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864927.231040:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087015552:0@lo:400:kworker.0 00010000:00010000:1.0:1787864927.296464:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864927.395542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864927.395583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864927.395615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864927.395618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254400 00000100:00100000:3.0:1787864927.395630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254400 00000100:00100000:1.0:1787864927.395640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864927.395672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864927.395690:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:1.0:1787864927.395702:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254528 00000100:00100000:3.0:1787864927.395703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071254400:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864927.395710:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254528 00000100:00100000:1.0:1787864927.395753:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254656 00000100:00100000:1.0:1787864927.395756:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254656 00000100:00100000:3.0:1787864927.395775:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071254400:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864927.395782:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787864927.395787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:1.0:1787864927.395794:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071254528:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864927.395822:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254784 00000100:00100000:3.0:1787864927.395827:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254784 00000100:00100000:1.0:1787864927.395835:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071254528:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864927.395842:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787864927.395870:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787864927.395874:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071254912 00000100:00100000:3.0:1787864927.395879:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071254912 00000100:00100000:1.0:1787864927.395881:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071254656:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864927.395912:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787864927.395914:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071254656:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864927.395925:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071254784:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864927.395925:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787864927.395960:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071254784:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864927.395967:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787864927.395980:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787864927.395986:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071254912:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864927.396009:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071254912:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864927.396015:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00080000:3.0:1787864927.396037:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864927.396040:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864927.396051:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864927.740798:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087015936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864927.740874:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864927.740953:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087015936 00000100:00100000:0.0:1787864927.740961:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087015936 00000100:00100000:0.0:1787864927.741003:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864927.741011:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087015936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864927.741051:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864927.744815:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087015936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3793us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864927.744838:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787864927.746289:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353c000 x1874712087015936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864927.746316:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087015936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864928.320054:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864929.339719:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864930.067364:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787864930.302261:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864930.302291:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f41cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087016064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864930.302414:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.302493:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016064 00000100:00100000:3.0:1787864930.302502:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016064 00000100:00100000:3.0:1787864930.302565:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864930.302581:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087016064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864930.302625:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864930.302680:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087016064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.302688:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787864930.302712:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864930.302744:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f41cb40 x1874712087016064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864930.302767:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f41cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087016064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864930.363703:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864931.388451:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864932.354625:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087016192:0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.354704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864932.355063:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087016320:0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.355099:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864932.355132:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087016448:0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.355155:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864932.355198:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016320 00000100:00100000:3.0:1787864932.355206:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016320 00000100:00100000:3.0:1787864932.355251:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016448 00000100:00100000:3.0:1787864932.355254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016448 00000100:00100000:3.0:1787864932.355279:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864932.355288:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087016320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.355334:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087016320:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864932.355341:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864932.355357:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787864932.355364:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087016448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.355393:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087016448:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864932.355415:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787864932.355434:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864932.355516:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087016704:0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.355540:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864932.355561:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087016576:0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.355588:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864932.355610:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016192 00000100:00100000:0.0:1787864932.355613:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016192 00000100:00100000:0.0:1787864932.355637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787864932.355643:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.355675:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087016192:12345-0@lo:400:kworker.0 Request processed in 32us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.355681:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787864932.355706:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016704 00000100:00100000:0.0:1787864932.355710:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016704 00000100:00100000:0.0:1787864932.355731:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787864932.355737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.357700:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087016704:12345-0@lo:400:kworker.0 Request processed in 1944us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.357711:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787864932.357907:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087016320:0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.357919:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087016832:0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.357956:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864932.358011:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016576 00000100:00100000:3.0:1787864932.358017:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016576 00000100:00100000:3.0:1787864932.358056:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016832 00000100:00100000:3.0:1787864932.358059:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016832 00000100:00100000:3.0:1787864932.358081:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787864932.358305:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864932.358314:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087016832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.358365:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087016832:12345-0@lo:400:kworker.0 Request processed in 53us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.358382:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787864932.358431:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353de00 x1874712087016832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864932.358442:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087016832:0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.358494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087016576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864932.358541:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087016576:12345-0@lo:400:kworker.0 Request processed in 454us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864932.358548:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787864932.358575:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864932.358578:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864932.358581:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864932.358630:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087016448:0@lo:400:kworker.0 00010000:00080000:0.0:1787864932.359586:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353f480 x1874712087016576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864932.359599:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087016576:0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.359631:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087016704:0@lo:400:kworker.0 00000100:00100000:0.0:1787864932.359649:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087016192:0@lo:400:kworker.0 00010000:00010000:1.0:1787864932.411545:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864932.516335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864932.516386:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864932.516474:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864932.516540:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255296 00000100:00100000:1.0:1787864932.516551:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255296 00000100:00100000:2.0:1787864932.516632:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255168 00000100:00100000:2.0:1787864932.516638:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255168 00000100:00100000:1.0:1787864932.516639:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787864932.516652:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071255296:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864932.516677:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787864932.516688:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071255168:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864932.516772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255040 00000100:00100000:0.0:1787864932.516777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255040 00000100:00100000:0.0:1787864932.516820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:0.0:1787864932.516836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071255040:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864932.516880:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2357:x1874712071255296:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00080000:3.0:1787864932.516881:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864932.516892:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:2.0:1787864932.521155:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071255168:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 4455us (4665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864932.521170:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787864932.522208:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071255040:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 5375us (5883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.522219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:3.0:1787864932.529900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864932.530062:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255424 00000100:00100000:0.0:1787864932.530072:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255424 00000100:00100000:0.0:1787864932.530159:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787864932.530170:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2355:x1874712071255424:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:0.0:1787864932.530198:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191a22 00000100:00080000:0.0:1787864932.530206:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864932.530246:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787864932.530330:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864932.530361:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255552 00000100:00100000:3.0:1787864932.530365:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255552 00010000:00010000:2.0:1787864932.530492:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864932.530628:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:259279c0-f351-4175-bf32-3107511ab0a0+2:2355:x1874712071255424:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 459us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.530636:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00080000:1.0:1787864932.530777:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864932.530782:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864932.530820:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787864932.530843:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2355:x1874712071255552:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:3.0:1787864932.530861:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191a29 00000100:00080000:3.0:1787864932.530867:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787864932.530903:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787864932.530960:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864932.531147:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:259279c0-f351-4175-bf32-3107511ab0a0+2:2355:x1874712071255552:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 317us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864932.531155:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787864932.862531:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864932.862581:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087016960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864932.862679:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864932.862756:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087016960 00000100:00100000:0.0:1787864932.862764:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087016960 00000100:00100000:0.0:1787864932.862820:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864932.862842:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087016960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864932.862887:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864932.863112:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087016960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864932.863121:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787864932.863171:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353e580 x1874712087016960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864932.863194:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087016960:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1787864933.197971:0:11167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe56849f00 20000000:00000080:2.0:1787864933.197995:0:11167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa23bc2b000 uarg=0000000000000000 20000000:01000000:2.0:1787864933.198038:0:11167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787864933.198045:0:11167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787864933.198051:0:11167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787864933.199071:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787864933.199254:0:11167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787864933.206230:0:11167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787864933.206275:0:11167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206301:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206311:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206317:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919ea expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206324:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206350:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.206358:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.207309:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.207332:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 12 pid: 5842 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.207350:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b823840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017088:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864933.208224:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.208240:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 18 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.208254:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8212c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017216:0@lo:104: 00000100:00100000:2.0:1787864933.208312:0:11167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864933.208476:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.208486:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 18 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.208495:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017344:0@lo:104: 00000100:00100000:2.0:1787864933.208538:0:11167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864933.209122:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.209133:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 18 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.209142:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017472:0@lo:104: 00000100:00100000:2.0:1787864933.209277:0:11167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864933.209298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017216 00000100:00100000:1.0:1787864933.209306:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017216 00000100:00100000:1.0:1787864933.209355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017344 00000100:00100000:1.0:1787864933.209358:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017344 00000100:00100000:1.0:1787864933.209374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864933.209393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:11167:x1874712087017216:12345-0@lo:104: 00010000:00010000:1.0:1787864933.209430:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209491:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864933.209497:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:11167:x1874712087017216:12345-0@lo:104: Request processed in 116us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.209505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864933.209524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787864933.209530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11167:x1874712087017344:12345-0@lo:104: 00010000:00010000:1.0:1787864933.209538:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209573:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864933.209578:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11167:x1874712087017344:12345-0@lo:104: Request processed in 49us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.209604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787864933.209625:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864933.209631:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209639:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351a00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864933.209644:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209653:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864933.209660:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864933.209666:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864933.209700:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209707:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864933.209731:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209739:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b351a00/0xa63eebe1861919f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209754:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864933.209758:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864933.209929:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864933.209968:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219851c00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864933.209971:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.209979:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864933.209985:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864933.209991:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864933.210020:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210027:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864933.210054:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210062:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851c00/0xa63eebe1861919ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210076:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864933.210078:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864933.210080:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864933.210108:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087017600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864933.210152:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864933.210208:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864933.210218:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087017728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864933.210257:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864933.210289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017600 00000100:00100000:1.0:1787864933.210294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017600 00010000:00010000:1.0:1787864933.210316:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 19 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.210336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017728 00000100:00100000:1.0:1787864933.210339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017728 00010000:00010000:1.0:1787864933.210347:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 20 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.210363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864933.210370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3318:x1874712087017600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864933.210380:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864933.210385:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 20 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210426:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 20 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210448:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864933.210479:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3318:x1874712087017600:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.210486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864933.210534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864933.210540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087017728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864933.210546:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864933.210550:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210569:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 19 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.210579:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864933.210971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087017728:12345-0@lo:103:ldlm_bl.0 Request processed in 429us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.210978:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864933.211042:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087017600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864933.211705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864933.211767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255680 00000100:00100000:1.0:1787864933.211838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255680 00010000:00010000:1.0:1787864933.211867:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 13 pid: 5842 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.211902:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787864933.211910:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071255680:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864933.211921:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864933.211926:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 13 pid: 5842 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.211938:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 13 pid: 5842 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.211957:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864933.212001:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071255680:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.212021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00010000:00010000:2.0:1787864933.212500:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.212516:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.212529:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b821680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017856:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864933.212573:0:11167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a96c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787864933.213093:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2b600/0xa63eebe186191a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7868 expref: 12 pid: 5842 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.213111:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b823840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017088:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864933.213127:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850e00/0xa63eebe1861919ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861919f8 expref: 18 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.213135:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8212c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017216:0@lo:104: 00010000:00010000:2.0:1787864933.213145:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850c00/0xa63eebe1861919f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861919ea expref: 17 pid: 5844 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.213153:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017344:0@lo:104: 00000100:00100000:1.0:1787864933.213313:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017472 00000100:00100000:1.0:1787864933.213326:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017472 00000100:00100000:1.0:1787864933.213368:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864933.213376:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b821e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11167:x1874712087017472:12345-0@lo:104: 00010000:00010000:1.0:1787864933.213662:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.213926:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864933.213933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b821e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11167:x1874712087017472:12345-0@lo:104: Request processed in 558us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.213942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787864933.213967:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864933.213973:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.213982:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787864933.213986:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.213996:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864933.214003:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864933.214022:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864933.214066:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.214073:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864933.214095:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.214111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b351200/0xa63eebe1861919dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe1861919e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.214130:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864933.214132:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864933.214133:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864933.214143:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864933.214158:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087017984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864933.214210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864933.214254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087017984 00000100:00100000:1.0:1787864933.214259:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087017984 00010000:00010000:1.0:1787864933.214282:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 17 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.214305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864933.214312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712087017984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864933.214323:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864933.214327:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 17 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.214338:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 17 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.214355:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864933.214379:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712087017984:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.214416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864933.214452:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087017984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864933.214584:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087017728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864933.215101:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219851200/0xa63eebe1861919e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe1861919dc expref: 16 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.215116:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017472:0@lo:104: 00000100:00100000:3.0:1787864933.217781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864933.217898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255808 00000100:00100000:1.0:1787864933.217910:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255808 00010000:00010000:1.0:1787864933.217959:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.218077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:1.0:1787864933.218095:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:2359:x1874712071255808:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864933.218112:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864933.218119:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218134:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218161:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218169:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218188:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218196:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218203:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218210:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218232:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864933.218237:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218247:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.218250:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ba00/0xa63eebe1861919d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7830 expref: 12 pid: 5844 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864933.218263:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864933.218274:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b821680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1874712087017856:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864933.218279:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864933.218319:0:11167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.218329:0:11167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.218336:0:11167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864933.218342:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa203580c00/0xa63eebe186191a30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864933.218357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:2359:x1874712071255808:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 265us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864933.218369:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00010000:00010000:0.0:1787864933.437110:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864934.459668:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787864934.975219:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864934.975227:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105678000 from 7 10000000:01000000:3.0:1787864934.975232:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864934.975274:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864934.975285:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864934.975303:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864934.975326:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864934.975388:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864934.975453:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b53b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787864934.975507:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018112 00000100:00100000:0.0:1787864934.975513:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018112 00000100:00100000:0.0:1787864934.975563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787864934.975573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087018112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864934.975586:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864934.975605:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191a37 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.976362:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191a37 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.976376:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a37 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.976385:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2ba00, rc 0) 00000100:00100000:0.0:1787864934.976463:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 892us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.976471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787864934.977747:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864934.977770:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864934.977782:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864934.977864:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864934.977909:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864934.977943:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864934.979531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018240 00000100:00100000:0.0:1787864934.979541:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018240 00000100:00100000:0.0:1787864934.979624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787864934.979634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864934.979933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.979942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787864934.980069:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864934.980112:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864934.980159:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864934.980193:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864934.982424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018368 00000100:00100000:3.0:1787864934.982435:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018368 00000100:00100000:3.0:1787864934.982488:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787864934.982497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864934.982698:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864934.982706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787864934.982760:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787864934.983541:0:11262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787864934.983586:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787864934.983606:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864934.983615:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864934.983626:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864934.983637:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864934.983639:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23be5b800 from 7 10000000:01000000:3.0:1787864934.983642:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864934.983669:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864934.983684:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864934.983694:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864934.983713:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864934.983753:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864934.983786:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b53b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864934.984451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018496 00000100:00100000:0.0:1787864934.984458:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018496 00000100:00100000:0.0:1787864934.984499:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787864934.984508:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087018496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864934.984519:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864934.984533:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191a45 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.984556:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191a45 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.984576:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a45 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864934.984585:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2aa00, rc 0) 00000100:00100000:0.0:1787864934.984632:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.984638:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787864934.984751:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864934.984764:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864934.984773:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864934.984893:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864934.984921:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864934.985297:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864934.990037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018624 00000100:00100000:0.0:1787864934.990050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018624 00000100:00100000:0.0:1787864934.990107:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787864934.990117:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864934.990382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.990390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787864934.990923:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864934.990966:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864934.991008:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864934.991041:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864934.993792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018752 00000100:00100000:0.0:1787864934.993801:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018752 00000100:00100000:0.0:1787864934.994017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787864934.994027:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864934.994232:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.994240:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787864934.997833:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787864935.001462:0:11266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787864935.002489:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787864935.002512:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864935.002522:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864935.002534:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864935.002543:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787864935.002545:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2100e4000 from 7 10000000:01000000:2.0:1787864935.002548:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864935.002581:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864935.002589:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864935.002599:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864935.002622:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864935.002686:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864935.002767:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864935.006520:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087018880 00000100:00100000:1.0:1787864935.006534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087018880 00000100:00100000:1.0:1787864935.006624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787864935.006635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087018880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864935.006649:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864935.006665:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191a53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864935.006689:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191a53 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864935.006700:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a53 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864935.006709:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ba00, rc 0) 00000100:00100000:1.0:1787864935.006783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087018880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.006790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787864935.006866:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8221c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087018880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864935.006883:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864935.006893:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864935.006952:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087019008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.006982:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864935.012023:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b53b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864935.012088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019008 00000100:00100000:0.0:1787864935.012097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019008 00000100:00100000:0.0:1787864935.012142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787864935.012152:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087019008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864935.012419:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087019008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (5435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.012433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787864935.018926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864935.018963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071255936 00000100:00100000:3.0:1787864935.018971:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071255936 00000100:00100000:3.0:1787864935.019019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:3.0:1787864935.019029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:5595:x1874712071255936:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864935.019043:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864935.019060:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7892 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864935.019097:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864935.019109:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864935.019118:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351e00, rc 0) 00000100:00100000:3.0:1787864935.019171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071255936:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 144us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864935.019178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:3.0:1787864935.019238:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087019008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.019286:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087019136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.019328:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864935.019356:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b53b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864935.019369:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019136 00000100:00100000:3.0:1787864935.019372:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019136 00000100:00100000:3.0:1787864935.019413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787864935.019421:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087019136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.019574:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087019136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864935.019580:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787864935.019616:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087019136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787864935.023521:0:11267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787864935.024268:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787864935.024290:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864935.024300:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864935.024313:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864935.026368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864935.026573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256064 00000100:00100000:3.0:1787864935.026583:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256064 00000100:00100000:3.0:1787864935.026644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:3.0:1787864935.026654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071256064:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.026907:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071256064:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 254us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864935.026915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:3.0:1787864935.028717:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864935.028790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256192 00000100:00100000:1.0:1787864935.028798:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256192 00000100:00100000:1.0:1787864935.028851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:1.0:1787864935.028860:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071256192:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864935.029036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071256192:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 176us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.029052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:3.0:1787864935.043622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864935.044181:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256320 00000100:00100000:0.0:1787864935.044192:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256320 00000100:00100000:0.0:1787864935.044252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:0.0:1787864935.044262:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071256320:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864935.044277:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864935.044292:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7899 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864935.044318:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864935.044329:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864935.044337:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a600, rc 0) 00000100:00100000:0.0:1787864935.044392:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071256320:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 132us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.044428:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:2.0:1787864935.052129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864935.052249:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256448 00000100:00100000:3.0:1787864935.052258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256448 00000100:00100000:3.0:1787864935.052311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:3.0:1787864935.052321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071256448:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864935.052617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071256448:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 288us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864935.052626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:3.0:1787864935.054663:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864935.054735:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256576 00000100:00100000:0.0:1787864935.054753:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256576 00000100:00100000:0.0:1787864935.054799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:0.0:1787864935.054808:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071256576:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864935.055004:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071256576:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 197us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.055012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:2.0:1787864935.419585:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864935.419608:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087019264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864935.419671:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864935.419739:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019264 00000100:00100000:2.0:1787864935.419746:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019264 00000100:00100000:2.0:1787864935.419825:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864935.419834:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087019264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864935.419864:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864935.419905:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087019264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864935.419912:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787864935.419951:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cf840 x1874712087019264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864935.419966:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087019264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864935.420036:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787864935.485294:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787864935.971339:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00000020:00000080:0.0:1787864935.971347:0:6719:0:(genops.c:885:class_export_put()) final put ffff9fa203fd5000/259279c0-f351-4175-bf32-3107511ab0a0 00000020:00000080:0.0:1787864935.971380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203fd5000/259279c0-f351-4175-bf32-3107511ab0a0 for lustre-OST0000 00000020:00000080:0.0:1787864935.971447:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa203fd2800 for lustre-OST0000 00000001:02000400:1.0:1787864936.207237:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787864936.507637:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864937.467584:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087019520:0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.467832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864937.467876:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087020032:0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.467900:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864937.467927:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864937.467933:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087019648:0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.467951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864937.467984:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019520 00000100:00100000:0.0:1787864937.467990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019520 00000100:00100000:0.0:1787864937.468027:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019648 00000100:00100000:0.0:1787864937.468030:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019648 00000100:00100000:0.0:1787864937.468056:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787864937.468064:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087019520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.468108:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087019520:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.468126:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787864937.468218:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787864937.468225:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087019648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.468256:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087019648:12345-0@lo:400:kworker.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.468262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787864937.468285:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864937.468313:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087019648:0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.468322:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087019520:0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.468418:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087019776:0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.468446:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864937.468466:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787864937.468471:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087019392:0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.468495:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864937.468513:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087019904:0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.468531:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864937.468555:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019904 00000100:00100000:1.0:1787864937.468559:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019904 00000100:00100000:1.0:1787864937.468583:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787864937.468588:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087019904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.468741:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087019904:12345-0@lo:400:kworker.0 Request processed in 151us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864937.468747:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787864937.468773:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087019904:0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.468909:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020032 00000100:00100000:0.0:1787864937.468914:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020032 00000100:00100000:0.0:1787864937.468953:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019776 00000100:00100000:0.0:1787864937.468956:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019776 00000100:00100000:0.0:1787864937.468980:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787864937.468987:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087020032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.469025:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087020032:12345-0@lo:400:kworker.0 Request processed in 39us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.469031:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787864937.469041:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864937.469047:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087019776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.469078:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087019776:12345-0@lo:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.469083:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864937.469100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087019392 00000100:00100000:0.0:1787864937.469103:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087019392 00000100:00080000:1.0:1787864937.469234:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864937.469238:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864937.469240:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864937.469550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787864937.469559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864937.469606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087019392:12345-0@lo:400:kworker.0 Request processed in 37us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.469613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:1.0:1787864937.469893:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353d680 x1874712087020032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864937.469905:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087020032:0@lo:400:kworker.0 00000100:00100000:1.0:1787864937.469946:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087019392:0@lo:400:kworker.0 00010000:00080000:1.0:1787864937.469958:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353f0c0 x1874712087019776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864937.469968:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087019776:0@lo:400:kworker.0 00000001:00100000:2.0:1787864937.515356:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00000020:00000080:2.0:1787864937.515364:0:7645:0:(genops.c:885:class_export_put()) final put ffff9fa203fd0000/259279c0-f351-4175-bf32-3107511ab0a0 00000020:00000080:1.0:1787864937.515488:0:495:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203fd0000/259279c0-f351-4175-bf32-3107511ab0a0 for lustre-OST0001 00000020:00000080:1.0:1787864937.515541:0:495:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa203fd1000 for lustre-OST0001 00010000:00010000:1.0:1787864937.533416:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864937.635257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864937.635299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864937.635329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864937.635357:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256960 00000100:00100000:2.0:1787864937.635365:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256960 00000100:00100000:2.0:1787864937.635431:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256832 00000100:00100000:2.0:1787864937.635434:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256832 00000100:00100000:2.0:1787864937.635460:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787864937.635469:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071256960:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864937.635546:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071256960:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.635554:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787864937.635570:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787864937.635576:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071256832:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864937.635599:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2356:x1874712071256832:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.635604:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787864937.635711:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071256704 00000100:00100000:1.0:1787864937.635716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071256704 00000100:00100000:1.0:1787864937.635750:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00100000:1.0:1787864937.635758:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071256704:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864937.635783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071256704:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864937.635788:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00080000:1.0:1787864937.635822:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864937.979705:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087020160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864937.979780:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864937.979919:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020160 00000100:00100000:0.0:1787864937.979927:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020160 00000100:00100000:0.0:1787864937.979989:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787864937.979999:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087020160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864937.980043:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864937.980089:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b823c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087020160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.980097:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787864937.980559:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20353da40 x1874712087020160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864937.980579:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087020160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864938.557880:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864939.543742:0:11466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:08:58 (1787864938) === 00010000:00010000:0.0:1787864939.581833:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864939.764963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864939.765085:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864939.765583:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257216 00000100:00100000:2.0:1787864939.765592:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257216 00000100:00100000:2.0:1787864939.765723:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787864939.765735:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:9676:x1874712071257216:12345-192.168.206.10@tcp:700:mkdir.0 00000100:00100000:1.0:1787864939.765748:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257088 00000100:00100000:1.0:1787864939.765753:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257088 00000100:00100000:1.0:1787864939.765800:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787864939.765810:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071257088:12345-192.168.206.10@tcp:41:mkdir.0 00000100:00100000:2.0:1787864939.765823:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9676:x1874712071257216:12345-192.168.206.10@tcp:700:mkdir.0 Request processed in 90us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.765831:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000004:00000024:1.0:1787864939.765838:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787864939.765883:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864939.765888:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071257088:12345-192.168.206.10@tcp:41:mkdir.0 Request processed in 81us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.765896:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787864939.769264:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864939.769728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257472 00000100:00100000:2.0:1787864939.769737:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257472 00000100:00100000:2.0:1787864939.769801:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787864939.769810:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:9676:x1874712071257472:12345-192.168.206.10@tcp:36:mkdir.0 00010000:00010000:2.0:1787864939.769876:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864939.769940:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242143400/0xa63eebe186191950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f781b expref: 6 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.769960:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dc900) 00010000:00010000:2.0:1787864939.769993:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864939.770750:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.770766:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.770776:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.770817:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.770826:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.770832:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864939.774948:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787864939.774966:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775086:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775094:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775106:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864939.775110:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775117:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775482:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51d00) 00010000:00010000:2.0:1787864939.775487:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864939.775550:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.775559:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186191a6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864939.775578:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e6529c reply state 00000000a627a593 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864939.775641:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864939.775882:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9676:x1874712071257472:12345-192.168.206.10@tcp:36:mkdir.0 Request processed in 6068us (6622us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787864939.775892:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:2.0:1787864939.777826:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777841:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777848:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777854:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864939.777858:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777882:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777896:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa206f51c00) 00010000:00010000:2.0:1787864939.777899:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864939.777904:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.777910:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186191a76 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864939.797152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864939.797259:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257600 00000100:00100000:1.0:1787864939.797268:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257600 00000100:00100000:1.0:1787864939.797329:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787864939.797351:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:9677:x1874712071257600:12345-192.168.206.10@tcp:101:chmod.0 00010000:00010000:1.0:1787864939.797372:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864939.797425:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191a7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78a0 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797489:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797503:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797515:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864939.797570:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787864939.797573:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864939.797612:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797637:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191a7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a0 expref: 8 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797654:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a0 expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.797663:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864939.797666:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864939.797681:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a600, rc 0) 00000100:00100000:1.0:1787864939.797740:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9677:x1874712071257600:12345-192.168.206.10@tcp:101:chmod.0 Request processed in 392us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.797747:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787864939.801465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864939.801585:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257856 00000100:00100000:1.0:1787864939.801594:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257856 00000100:00100000:1.0:1787864939.801649:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787864939.801659:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9677:x1874712071257856:12345-192.168.206.10@tcp:36:chmod.0 00010000:00010000:1.0:1787864939.801710:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864939.801734:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191a84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a0 expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.801752:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864939.801761:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864939.801784:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.801808:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.801816:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864939.802281:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7589b40 reply state 00000000cbba9eb6 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864939.802291:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787864939.802315:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787864939.802588:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+8:9677:x1874712071257856:12345-192.168.206.10@tcp:36:chmod.0 Request processed in 929us (1129us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787864939.802605:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00010000:00010000:0.0:1787864939.809555:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809570:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809577:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809584:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864939.809588:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809596:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809628:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170a00) 00010000:00010000:0.0:1787864939.809631:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787864939.809635:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.809642:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ac00/0xa63eebe186191a8b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864939.844907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864939.845075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071257984 00000100:00100000:0.0:1787864939.845085:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071257984 00000100:00100000:0.0:1787864939.845197:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:0.0:1787864939.845209:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9678:x1874712071257984:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:0.0:1787864939.845244:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864939.845269:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845345:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845357:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845368:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864939.845463:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787864939.845468:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864939.845522:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845560:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a7 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845579:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a7 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.845586:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864939.845589:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864939.845593:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b800, rc 0) 00000100:00100000:0.0:1787864939.845660:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:9678:x1874712071257984:12345-192.168.206.10@tcp:101:chown.0 Request processed in 453us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.845667:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787864939.853537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864939.853645:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071258112 00000100:00100000:0.0:1787864939.853655:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071258112 00000100:00100000:0.0:1787864939.853713:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:0.0:1787864939.853723:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:9678:x1874712071258112:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:0.0:1787864939.853741:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864939.853760:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78ae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853833:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853846:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853857:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853885:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853892:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853898:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853990:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.853999:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854006:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864939.854042:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787864939.854047:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864939.854069:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854082:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854088:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854095:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854111:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864939.854115:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854135:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854150:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864939.854153:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864939.854158:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854164:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854179:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854186:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854192:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854197:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864939.854200:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854205:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854254:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa20378b700) 00010000:00010000:0.0:1787864939.854257:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864939.854260:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854265:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854305:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ae expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854319:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ae expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.854325:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b800) 00010000:00010000:0.0:1787864939.854328:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864939.854330:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a400, rc 0) 00000100:00100000:0.0:1787864939.854425:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:9678:x1874712071258112:12345-192.168.206.10@tcp:101:chown.0 Request processed in 675us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.854432:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787864939.857961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864939.858111:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071258368 00000100:00100000:1.0:1787864939.858120:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071258368 00000100:00100000:1.0:1787864939.858188:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:1.0:1787864939.858198:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+9:9678:x1874712071258368:12345-192.168.206.10@tcp:36:chown.0 00010000:00010000:1.0:1787864939.858258:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864939.858284:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2a400/0xa63eebe186191ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ae expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.858303:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b800) 00010000:00010000:1.0:1787864939.858314:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864939.858349:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.858361:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.858370:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864939.916373:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000663a2532 reply state 0000000094b8ebd2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864939.916427:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787864939.916672:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787864939.916855:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+10:9678:x1874712071258368:12345-192.168.206.10@tcp:36:chown.0 Request processed in 58650us (58893us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787864939.916867:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000001:00080000:0.0:1787864939.917884:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1787864939.917972:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.917986:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.917995:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.918001:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864939.918007:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.918032:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.918055:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864939.918058:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864939.918065:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.918073:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191abc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864939.969460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864939.969692:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071258496 00000100:00100000:0.0:1787864939.969709:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071258496 00000100:00100000:0.0:1787864939.969934:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787864939.969947:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:9679:x1874712071258496:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:0.0:1787864939.969983:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864939.970011:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864939.973725:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3624us 00010000:00010000:0.0:1787864940.007756:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.007797:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.007813:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.007832:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.007840:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.007848:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008440:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008451:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008459:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864940.008558:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787864940.008563:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864940.008700:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008717:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008725:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008733:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008740:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.008745:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008754:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008770:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864940.008774:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864940.008779:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008801:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008819:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008826:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008833:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008847:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.008850:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008858:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008868:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa20378b700) 00010000:00010000:0.0:1787864940.008871:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864940.008874:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008881:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008940:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78b5 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008959:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78b5 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.008967:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:0.0:1787864940.008969:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787864940.008972:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b600, rc 0) 00000100:00100000:0.0:1787864940.009082:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9679:x1874712071258496:12345-192.168.206.10@tcp:101:touch.500 Request processed in 39135us (39630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.009096:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787864940.013184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.013977:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071258752 00000100:00100000:3.0:1787864940.013991:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071258752 00000100:00100000:3.0:1787864940.014077:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787864940.014091:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9679:x1874712071258752:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:3.0:1787864940.014118:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864940.014157:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191adf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78bc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.015090:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.015113:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.016800:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.016840:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.016854:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.016862:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787864940.018166:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787864940.018670:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018697:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018709:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018756:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018764:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018771:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018777:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.018783:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018802:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018819:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:3.0:1787864940.018822:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864940.018828:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018836:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191ae6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864940.018850:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c255f829 reply state 00000000917e0763 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864940.018868:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787864940.018914:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191adf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78bc expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018971:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78bc expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.018979:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864940.018982:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864940.018985:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350000, rc 0) 00000100:00100000:3.0:1787864940.019087:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+10:9679:x1874712071258752:12345-192.168.206.10@tcp:101:touch.500 Request processed in 4998us (5919us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787864940.019098:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00010000:00010000:0.0:1787864940.021915:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021947:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021952:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021956:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.021960:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021966:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021982:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9fa20c8dc500) 00010000:00010000:0.0:1787864940.021984:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864940.021988:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.021992:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864940.028321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864940.029488:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259008 00000100:00100000:2.0:1787864940.029507:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259008 00000100:00100000:2.0:1787864940.029591:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:2.0:1787864940.029606:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+9:9679:x1874712071259008:12345-192.168.206.10@tcp:36:touch.500 00010000:00010000:2.0:1787864940.029684:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864940.029720:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78bc expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.029742:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20c8dc800) 00010000:00010000:2.0:1787864940.029755:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864940.029826:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.029843:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.029854:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864940.030069:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b07835ee reply state 00000000b8dca1a2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864940.030091:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864940.030232:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+10:9679:x1874712071259008:12345-192.168.206.10@tcp:36:touch.500 Request processed in 629us (1920us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787864940.030249:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00010000:00010000:2.0:1787864940.032466:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032486:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032495:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032502:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864940.032508:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032517:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032538:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa206f51c00) 00010000:00010000:2.0:1787864940.032542:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864940.032548:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.032555:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864940.033046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.033144:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259136 00000100:00100000:3.0:1787864940.033156:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259136 00000100:00100000:3.0:1787864940.033235:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787864940.033249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:9679:x1874712071259136:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:3.0:1787864940.033277:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864940.033302:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.033370:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78c3 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.033385:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78c3 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.033445:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20c8dc600) 00010000:00010000:3.0:1787864940.033449:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864940.033452:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00000100:00100000:3.0:1787864940.033539:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:9679:x1874712071259136:12345-192.168.206.10@tcp:101:touch.500 Request processed in 294us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.033548:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:1.0:1787864940.036169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864940.036239:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259264 00000100:00100000:0.0:1787864940.036251:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259264 00000100:00100000:0.0:1787864940.036306:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787864940.036316:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874712071259264:12345-192.168.206.10@tcp:8:touch.500 00010000:00080000:0.0:1787864940.036358:0:6695:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1787864940.036480:0:6695:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe186191b10 00002000:00100000:0.0:1787864940.036508:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ba0702c-0896-417b-a9c4-527e0244aed4/ffff9fa203fd0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864940.036540:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787864940.036956:0:6695:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864940.037001:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864940.037220:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071259264:12345-192.168.206.10@tcp:8:touch.500 Request processed in 903us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.037229:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787864940.038926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864940.039024:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259392 00000100:00100000:1.0:1787864940.039036:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259392 00000100:00100000:1.0:1787864940.039134:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787864940.039147:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:0:x1874712071259392:12345-192.168.206.10@tcp:2:touch.500 00000100:00080000:3.0:1787864940.041273:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787864940.082555:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000001:00080000:0.0:1787864940.082597:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787864940.083114:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:0:x1874712071259392:12345-192.168.206.10@tcp:2:touch.500 Request processed in 43960us (44189us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787864940.083995:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787864940.087548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864940.087983:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259648 00000100:00100000:1.0:1787864940.087997:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259648 00000100:00100000:1.0:1787864940.088261:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787864940.088276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:9679:x1874712071259648:12345-192.168.206.10@tcp:35:touch.500 00000100:00100000:1.0:1787864940.089727:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+11:9679:x1874712071259648:12345-192.168.206.10@tcp:35:touch.500 Request processed in 1445us (2184us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787864940.089740:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787864940.103658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.103999:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071259776 00000100:00100000:3.0:1787864940.104014:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071259776 00000100:00100000:3.0:1787864940.104098:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787864940.104110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+11:9680:x1874712071259776:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:3.0:1787864940.104390:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864940.104442:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78ca expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.104541:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.104560:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.104908:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864940.104986:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787864940.104990:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864940.105066:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.105104:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ca expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.105558:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ca expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.105570:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:3.0:1787864940.105573:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864940.105578:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864940.105672:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+12:9680:x1874712071259776:12345-192.168.206.10@tcp:101:rm.0 Request processed in 1563us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.105681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787864940.111763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864940.111915:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260032 00000100:00100000:2.0:1787864940.111928:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260032 00000100:00100000:2.0:1787864940.112003:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787864940.112015:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+12:9680:x1874712071260032:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:2.0:1787864940.112044:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864940.112071:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78d1 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864940.112246:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787864940.112453:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78d1 expref: 14 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.112470:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:2.0:1787864940.112473:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864940.112479:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78d1 expref: 14 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.112494:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580400, rc 0) 00000100:00100000:2.0:1787864940.112565:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:9680:x1874712071260032:12345-192.168.206.10@tcp:101:rm.0 Request processed in 552us (823us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787864940.112573:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787864940.118390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.119049:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260160 00000100:00100000:3.0:1787864940.119065:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260160 00000100:00100000:3.0:1787864940.119157:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787864940.119170:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:9680:x1874712071260160:12345-192.168.206.10@tcp:37:rm.0 00000100:00100000:2.0:1787864940.127321:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:9680:x1874712071260160:12345-192.168.206.10@tcp:37:rm.0 Request processed in 8136us (8929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864940.127346:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787864940.134280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864940.134504:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260416 00000100:00100000:1.0:1787864940.134518:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260416 00000100:00100000:1.0:1787864940.134727:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787864940.134742:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+13:9680:x1874712071260416:12345-192.168.206.10@tcp:35:rm.0 00000100:00100000:1.0:1787864940.135665:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:9680:x1874712071260416:12345-192.168.206.10@tcp:35:rm.0 Request processed in 921us (1552us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787864940.135676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787864940.139274:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864940.139460:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260672 00000100:00100000:2.0:1787864940.139474:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260672 00000100:00100000:2.0:1787864940.139572:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:2.0:1787864940.139595:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:9680:x1874712071260672:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:2.0:1787864940.139629:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864940.139656:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78d8 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.139851:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186191b3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.139869:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186191b3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.139883:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186191b3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864940.139897:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787864940.140108:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186191b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78d8 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.140145:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186191b3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78d8 expref: 16 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864940.140155:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:2.0:1787864940.140158:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864940.140162:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581c00, rc 0) 00000100:00100000:2.0:1787864940.140233:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071260672:12345-192.168.206.10@tcp:101:rm.0 Request processed in 652us (975us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787864940.140241:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787864940.144210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.144626:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260800 00000100:00100000:3.0:1787864940.144640:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260800 00000100:00100000:3.0:1787864940.144724:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787864940.144736:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071260800:12345-192.168.206.10@tcp:41:rm.0 00000004:00000024:3.0:1787864940.144837:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787864940.144945:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071260800:12345-192.168.206.10@tcp:41:rm.0 Request processed in 212us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.144955:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787864940.148689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.148900:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071260928 00000100:00100000:3.0:1787864940.148913:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071260928 00000100:00100000:3.0:1787864940.148990:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:3.0:1787864940.149004:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071260928:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:3.0:1787864940.149035:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864940.149063:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149157:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149173:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149186:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149203:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149210:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149216:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149340:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149347:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149379:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864940.149462:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787864940.149468:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864940.149490:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149504:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149514:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149523:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149529:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149535:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.149540:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149548:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149560:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:3.0:1787864940.149564:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864940.149571:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149598:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149615:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149622:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149627:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149632:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.149635:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149641:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149649:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864940.149652:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864940.149655:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149660:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149697:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78df expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149711:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78df expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.149724:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20c8dc600) 00010000:00010000:3.0:1787864940.149727:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864940.149729:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350600, rc 0) 00000100:00100000:1.0:1787864940.151041:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+17:9680:x1874712071260928:12345-192.168.206.10@tcp:101:rm.0 Request processed in 2027us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864940.151058:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:1.0:1787864940.154850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864940.154956:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071261184 00000100:00100000:0.0:1787864940.154968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071261184 00000100:00100000:0.0:1787864940.155071:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:0.0:1787864940.155084:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+17:9680:x1874712071261184:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:0.0:1787864940.155171:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787864940.155207:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78df expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155245:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78c3 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155277:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20c8dc600) 00010000:00010000:0.0:1787864940.155297:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186191b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ca expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155307:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:0.0:1787864940.155310:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864940.155338:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155354:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155365:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155383:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155391:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.155949:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.156302:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.156312:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.156332:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864940.157951:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787864940.157969:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256097571871ns, next at 257097566881ns, rc = 0 00010000:00010000:0.0:1787864940.158059:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158076:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158086:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158096:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158103:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158110:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158538:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787864940.158591:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158600:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158606:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158632:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.158638:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158648:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158664:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:0.0:1787864940.158667:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787864940.158674:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158680:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191b72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158704:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158711:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158718:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158724:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ae00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.158726:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158732:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158857:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:0.0:1787864940.158860:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864940.158864:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.158880:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191b64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864940.158895:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0d45a84 reply state 0000000081dbf785 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864940.158907:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864940.159040:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071261184:12345-192.168.206.10@tcp:36:rm.0 Request processed in 3952us (4198us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787864940.159052:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00010000:00010000:3.0:1787864940.164672:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164693:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164702:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164709:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.164715:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164724:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164930:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9fa20378ba00) 00010000:00010000:3.0:1787864940.164935:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864940.164941:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.164948:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ac00/0xa63eebe186191b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864940.165096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864940.165428:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071261440 00000100:00100000:2.0:1787864940.165462:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071261440 00000100:00100000:2.0:1787864940.165529:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787864940.165541:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:9680:x1874712071261440:12345-192.168.206.10@tcp:35:rm.0 00010000:00010000:1.0:1787864940.166131:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864940.166141:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864940.166152:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2be00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864940.166156:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864940.166176:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864940.166191:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:1.0:1787864940.166194:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864940.166198:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864940.166204:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2be00/0xa63eebe186191b79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864940.166235:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864940.166237:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864940.166239:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864940.166911:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071261440:12345-192.168.206.10@tcp:35:rm.0 Request processed in 1366us (1815us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787864940.166923:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787864940.170294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864940.170389:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071261696 00000100:00100000:3.0:1787864940.170426:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071261696 00000100:00100000:3.0:1787864940.170521:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:3.0:1787864940.170534:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+16:9680:x1874712071261696:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787864940.170639:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787864940.170676:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186191b3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78d8 expref: 16 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170704:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b600/0xa63eebe186191ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78b5 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170719:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20378b500) 00010000:00010000:3.0:1787864940.170737:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b800/0xa63eebe186191a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78a7 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170757:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864940.170765:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864940.170805:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170820:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170832:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170846:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170853:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.170871:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.171643:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.171655:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.171663:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864940.172899:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787864940.172925:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.172935:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.172943:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.172950:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.172956:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.172964:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.172980:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa20c8dc600) 00010000:00010000:3.0:1787864940.172983:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787864940.172997:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173004:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191b8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173029:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173036:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173041:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173046:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864940.173049:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173055:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173063:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864940.173065:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864940.173068:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864940.173074:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186191b80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864940.173085:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000315380be reply state 00000000c3373611 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864940.173105:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864940.173717:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+15:9680:x1874712071261696:12345-192.168.206.10@tcp:36:rm.0 Request processed in 3177us (3429us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787864940.173728:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00010000:00010000:0.0:1787864940.179615:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179639:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179647:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179654:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864940.179660:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179669:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179709:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa20c8dc300) 00010000:00010000:0.0:1787864940.179713:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864940.179719:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864940.179726:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191b87 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864940.539816:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864940.539848:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087020288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864940.539940:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864940.540171:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020288 00000100:00100000:0.0:1787864940.540181:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020288 00000100:00100000:0.0:1787864940.540279:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787864940.540290:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087020288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864940.540320:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864940.540380:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087020288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.540388:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787864940.540674:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c0c4000 x1874712087020288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864940.540696:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087020288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864940.540759:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787864940.604138:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864941.627575:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864942.598515:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087020416:0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.600677:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864942.600737:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087020928:0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.601660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020416 00000100:00100000:0.0:1787864942.601669:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020416 00000100:00100000:0.0:1787864942.601714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787864942.601722:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087020416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.602947:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087020416:12345-0@lo:400:kworker.0 Request processed in 1220us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864942.602959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787864942.613671:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087020544:0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.613737:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864942.613797:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087021056:0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.613833:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864942.613857:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864942.613876:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087020672:0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.613897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864942.613930:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087020800:0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.613957:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864942.614583:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021056 00000100:00100000:0.0:1787864942.614591:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021056 00000100:00100000:0.0:1787864942.614647:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020800 00000100:00100000:0.0:1787864942.614650:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020800 00000100:00100000:0.0:1787864942.614674:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864942.614683:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087021056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.614741:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087021056:12345-0@lo:400:kworker.0 Request processed in 59us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864942.614748:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864942.614846:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787864942.614855:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087020800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864942.615154:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087020800:12345-0@lo:400:kworker.0 Request processed in 301us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864942.615161:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787864942.616115:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23baa1680 x1874712087020800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864942.616129:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087020800:0@lo:400:kworker.0 00010000:00080000:0.0:1787864942.616265:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20cb5ed00 x1874712087021056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864942.616275:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087021056:0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.617991:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864942.618178:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020544 00000100:00100000:1.0:1787864942.618186:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020544 00000100:00100000:1.0:1787864942.618226:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020672 00000100:00100000:1.0:1787864942.618229:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020672 00000100:00100000:1.0:1787864942.618254:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087020928 00000100:00100000:1.0:1787864942.618257:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087020928 00000100:00100000:1.0:1787864942.618272:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787864942.618287:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618351:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087020544:12345-0@lo:400:kworker.0 Request processed in 72us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864942.618364:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787864942.618382:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787864942.618389:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618438:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087020672:12345-0@lo:400:kworker.0 Request processed in 50us (4539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864942.618444:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787864942.618455:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787864942.618461:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087020928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618484:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087020928:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864942.618489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787864942.618533:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087020672:0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618543:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087020544:0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618639:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087020928:0@lo:400:kworker.0 00000100:00100000:1.0:1787864942.618656:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087020416:0@lo:400:kworker.0 00000100:00080000:3.0:1787864942.624508:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864942.624517:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864942.624520:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787864942.658976:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864942.768313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864942.768358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864942.768420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864942.768476:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864942.768510:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071261824 00000100:00100000:1.0:1787864942.768522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071261824 00000100:00100000:1.0:1787864942.768577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:1.0:1787864942.768588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071261824:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864942.768694:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071261824:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864942.768703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:1.0:1787864942.768744:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262080 00000100:00100000:1.0:1787864942.768749:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262080 00000100:00100000:1.0:1787864942.768807:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787864942.768815:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071262080:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864942.768846:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071262080:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864942.768853:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787864942.769223:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071261952 00000100:00100000:0.0:1787864942.769229:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071261952 00000100:00100000:0.0:1787864942.769263:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262208 00000100:00100000:0.0:1787864942.769266:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262208 00000100:00100000:0.0:1787864942.769286:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787864942.769293:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071261952:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864942.769330:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071261952:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 38us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864942.769338:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787864942.769353:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787864942.769359:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071262208:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864942.769383:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071262208:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864942.769389:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00080000:0.0:1787864942.769447:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864942.769453:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864943.099652:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087021184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864943.099748:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864943.100000:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021184 00000100:00100000:2.0:1787864943.100009:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021184 00000100:00100000:2.0:1787864943.100087:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787864943.100100:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087021184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864943.100147:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864943.100205:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087021184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864943.100214:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787864943.100265:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b820780 x1874712087021184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864943.100287:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087021184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787864943.675692:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864944.523192:0:11615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787864944.699700:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787864945.239716:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787864945.239733:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787864945.239868:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864945.239888:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087021312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787864945.239957:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.240017:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021312 00000100:00100000:2.0:1787864945.240024:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021312 00000100:00100000:2.0:1787864945.240073:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864945.240082:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087021312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787864945.240108:0:6696:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787864945.240141:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a90a76c, atime: 0x6a90a76c, ctime: 0x6a90a76c, blocks: 0x1 00010000:00010000:2.0:1787864945.240149:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240166:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1787864945.240171:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864945.240178:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240196:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240206:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240214:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240231:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787864945.240790:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087021312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 706us (831us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787864945.240798:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787864945.240827:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864945.240833:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240842:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864945.240847:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240855:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240872:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240878:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761c2c0c/0xa63eebe186191b95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.240896:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864945.240898:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864945.240899:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787864945.240935:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa23b821680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787864945.240942:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087021312:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787864945.240987:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1787864945.241009:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00080000:0.0:1787864945.241470:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787864945.552359:0:11664:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd29e5c750 20000000:00000080:1.0:1787864945.552373:0:11664:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa23bd0bc00 uarg=0000000000000000 20000000:01000000:1.0:1787864945.552568:0:11664:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787864945.552574:0:11664:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787864945.552579:0:11664:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787864945.554961:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787864945.555230:0:11664:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787864945.560330:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787864945.560378:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787864945.560909:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787864945.560930:0:11664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864945.560948:0:11664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.560965:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a37 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.560973:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a45 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.560980:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191a53 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.560990:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561011:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561019:0:11664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561055:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561070:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.561084:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021440:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864945.561277:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561286:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.561295:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021568:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864945.561321:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561329:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 18 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.561338:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021696:0@lo:104: 00000100:00100000:3.0:1787864945.561368:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864945.561435:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561443:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 18 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.561451:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021824:0@lo:104: 00000100:00100000:3.0:1787864945.561486:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864945.561517:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.561525:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 18 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.561533:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021952:0@lo:104: 00000100:00100000:3.0:1787864945.561553:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864945.561562:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864945.561705:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787864945.561719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021696 00000100:00100000:0.0:1787864945.561725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021696 00000100:00100000:0.0:1787864945.561768:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021824 00000100:00100000:0.0:1787864945.561772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021824 00000100:00100000:0.0:1787864945.561783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087021952 00000100:00100000:0.0:1787864945.561785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087021952 00000100:00100000:0.0:1787864945.561809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864945.561817:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:11664:x1874712087021696:12345-0@lo:104: 00010000:00010000:0.0:1787864945.561830:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.561896:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864945.561902:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+5:11664:x1874712087021696:12345-0@lo:104: Request processed in 86us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.561909:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864945.561925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864945.561931:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:11664:x1874712087021824:12345-0@lo:104: 00010000:00010000:0.0:1787864945.561938:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.561967:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787864945.561972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+4:11664:x1874712087021824:12345-0@lo:104: Request processed in 41us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.561977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864945.561987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864945.561993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa10578b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11664:x1874712087021952:12345-0@lo:104: 00010000:00010000:0.0:1787864945.561999:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562026:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787864945.562031:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa10578b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+3:11664:x1874712087021952:12345-0@lo:104: Request processed in 39us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.562037:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787864945.562069:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864945.562075:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562083:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580e00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:0.0:1787864945.562103:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562113:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864945.562121:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864945.562127:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864945.562154:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562161:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864945.562179:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562186:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa203580e00/0xa63eebe186191a53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562199:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864945.562203:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562209:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:0.0:1787864945.562212:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562219:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864945.562235:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864945.562241:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864945.562253:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562259:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864945.562274:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562282:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b351600/0xa63eebe186191a45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562290:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864945.562294:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562299:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:0.0:1787864945.562302:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562309:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864945.562316:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864945.562322:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864945.562339:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562345:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864945.562352:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562359:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b351400/0xa63eebe186191a37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186191a3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562371:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864945.562373:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864945.562374:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864945.562380:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864945.562385:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864945.562428:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087022080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864945.562458:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.562503:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087022208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864945.562525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.562544:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864945.562549:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087022336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864945.562569:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.562601:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022080 00000100:00100000:0.0:1787864945.562605:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022080 00010000:00010000:0.0:1787864945.562622:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 19 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864945.562641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022208 00000100:00100000:0.0:1787864945.562644:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022208 00010000:00010000:0.0:1787864945.562653:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 20 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864945.562669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022336 00000100:00100000:0.0:1787864945.562671:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022336 00010000:00010000:0.0:1787864945.562680:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 21 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864945.562691:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864945.562696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3318:x1874712087022080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864945.562705:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864945.562709:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 21 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562718:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 21 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562733:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864945.562769:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3318:x1874712087022080:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.562774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864945.562787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864945.562803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3315:x1874712087022208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864945.562810:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864945.562814:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 20 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562823:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 20 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562832:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864945.562859:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+20:3315:x1874712087022208:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.562865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864945.562875:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864945.562881:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087022336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864945.562886:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864945.562890:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 19 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562898:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 19 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.562907:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864945.562922:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087022336:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.562927:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864945.562975:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087022080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864945.562993:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087022336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864945.562999:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087022208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864945.563285:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ba00/0xa63eebe186191a5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191a53 expref: 18 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.563297:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021696:0@lo:104: 00010000:00010000:3.0:1787864945.563306:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2aa00/0xa63eebe186191a4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191a45 expref: 17 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.563314:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021824:0@lo:104: 00010000:00010000:3.0:1787864945.563321:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2ba00/0xa63eebe186191a3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186191a37 expref: 16 pid: 5844 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.563328:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021952:0@lo:104: 00000100:00100000:3.0:1787864945.566751:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021440:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864945.566917:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1874712087021568:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864945.566953:0:11664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864945.571153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864945.571226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262336 00000100:00100000:0.0:1787864945.571235:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262336 00010000:00010000:0.0:1787864945.571273:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864945.571306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787864945.571315:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071262336:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864945.571329:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864945.571347:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.571359:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.571376:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191a68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7899 expref: 13 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864945.571392:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864945.571476:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:2358:x1874712071262336:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 162us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.571484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787864945.578543:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864945.578629:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262464 00000100:00100000:3.0:1787864945.578639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262464 00010000:00010000:3.0:1787864945.578680:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.578725:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787864945.578735:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:2356:x1874712071262464:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864945.578751:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864945.578768:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578782:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578813:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7892 expref: 12 pid: 5844 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578829:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578836:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578853:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578876:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578883:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578889:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578894:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864945.578898:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578907:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578928:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864945.578939:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864945.579015:0:11664:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.579026:0:11664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864945.579033:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b350400/0xa63eebe186191b9c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864945.579321:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:2356:x1874712071262464:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 586us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864945.579330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787864945.665101:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087022464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864945.665171:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864945.665323:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022464 00000100:00100000:3.0:1787864945.665330:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022464 00000100:00100000:3.0:1787864945.665384:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864945.665421:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087022464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864945.665456:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864945.665502:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087022464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864945.665518:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864945.665623:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087022464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864945.724278:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.747604:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864947.323508:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864947.323516:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105678000 from 7 10000000:01000000:0.0:1787864947.323521:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864947.323566:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.323579:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.323591:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864947.323634:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.323716:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.323786:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487600 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.324041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022592 00000100:00100000:1.0:1787864947.324047:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022592 00000100:00100000:1.0:1787864947.324107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787864947.324116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:5846:x1874712087022592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.324129:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864947.324143:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ac00/0xa63eebe186191baa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191ba3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.324180:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ac00/0xa63eebe186191baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191ba3 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.324189:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ac00/0xa63eebe186191baa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191ba3 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.324198:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ac00, rc 0) 00000100:00100000:1.0:1787864947.324758:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087022592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 633us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.324766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787864947.326813:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864947.326840:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.326852:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864947.326994:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.327049:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.327098:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.327128:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022720 00000100:00100000:1.0:1787864947.327134:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022720 00000100:00100000:1.0:1787864947.327184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787864947.327193:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087022720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.329170:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087022720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1971us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.329184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787864947.329302:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.329355:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.329434:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.329474:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.329505:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022848 00000100:00100000:1.0:1787864947.329511:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022848 00000100:00100000:1.0:1787864947.329806:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787864947.329816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087022848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.330057:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087022848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.330065:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787864947.330348:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b823480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.333227:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11678:1874712087022976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864947.333392:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.333454:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.333538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087022976 00000100:00100000:3.0:1787864947.333545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087022976 00000100:00100000:3.0:1787864947.333640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787864947.333651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:11678:x1874712087022976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864947.334006:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:11678:x1874712087022976:12345-0@lo:502:llog_process_th.0 Request processed in 357us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.334015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787864947.334113:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11678:1874712087022976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864947.334141:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864947.334150:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864947.334153:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864947.334159:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa105678000 00000020:00000080:1.0:1787864947.334161:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864947.334239:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11678:1874712087023104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864947.337229:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.343381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023104 00000100:00100000:0.0:1787864947.343406:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023104 00000100:00100000:0.0:1787864947.343458:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787864947.343468:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:11678:x1874712087023104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864947.343716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:11678:x1874712087023104:12345-0@lo:502:llog_process_th.0 Request processed in 249us (6493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.343724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787864947.343869:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.343892:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11678:1874712087023104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864947.343924:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864947.343932:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864947.343934:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787864947.343938:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787864947.344005:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787864947.344029:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864947.344038:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344048:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864947.344058:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864947.344061:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23be5b800 from 7 10000000:01000000:0.0:1787864947.344064:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864947.344113:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344122:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344132:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864947.344152:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.344187:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.344205:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.344217:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023232 00000100:00100000:0.0:1787864947.344221:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023232 00000100:00100000:0.0:1787864947.344238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787864947.344244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:5846:x1874712087023232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864947.344456:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864947.344468:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2a400/0xa63eebe186191bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191bb1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344489:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2a400/0xa63eebe186191bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191bb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344499:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2a400/0xa63eebe186191bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191bb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344508:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a400, rc 0) 00000100:00100000:0.0:1787864947.344538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.344545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787864947.344584:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864947.344596:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.344604:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864947.344648:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.344671:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.344685:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2035b0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.344766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023360 00000100:00100000:0.0:1787864947.344770:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023360 00000100:00100000:0.0:1787864947.344788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787864947.344794:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.345002:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.345009:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787864947.345036:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.345059:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.345323:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.345338:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2035b0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.345350:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023488 00000100:00100000:0.0:1787864947.345355:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023488 00000100:00100000:0.0:1787864947.345373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787864947.345379:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.345529:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.345542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787864947.345578:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.350980:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11681:1874712087023616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864947.351053:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864947.351103:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.351203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023616 00000100:00100000:0.0:1787864947.351210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023616 00000100:00100000:0.0:1787864947.351264:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787864947.351273:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:11681:x1874712087023616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864947.351507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:11681:x1874712087023616:12345-0@lo:502:llog_process_th.0 Request processed in 234us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.351514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787864947.351672:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11681:1874712087023616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864947.351711:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864947.351721:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864947.351724:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864947.351731:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa23be5b800 00000020:00000080:1.0:1787864947.351733:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864947.351827:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11681:1874712087023744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864947.351864:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.351888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023744 00000100:00100000:1.0:1787864947.351893:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023744 00000100:00100000:1.0:1787864947.351914:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787864947.351920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:11681:x1874712087023744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864947.352039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:11681:x1874712087023744:12345-0@lo:502:llog_process_th.0 Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.352047:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787864947.352094:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.352111:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11681:1874712087023744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864947.352131:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864947.352135:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864947.352137:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787864947.352140:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787864947.354371:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787864947.354418:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864947.354429:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354443:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864947.354452:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864947.354455:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2100e4000 from 7 10000000:01000000:0.0:1787864947.354458:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864947.354491:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354498:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354508:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864947.354540:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.354593:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.354625:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2035b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.354647:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087023872 00000100:00100000:0.0:1787864947.354653:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087023872 00000100:00100000:0.0:1787864947.354685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787864947.354862:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:5846:x1874712087023872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864947.354876:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864947.354888:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2be00/0xa63eebe186191bc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186191bbf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354910:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2be00/0xa63eebe186191bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186191bbf expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354921:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2be00/0xa63eebe186191bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186191bbf expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.354929:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2be00, rc 0) 00000100:00100000:0.0:1787864947.355020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087023872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.355027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787864947.361599:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087023872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864947.361628:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.361641:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864947.362424:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087024000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.362492:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864947.362531:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.362614:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024000 00000100:00100000:1.0:1787864947.362621:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024000 00000100:00100000:1.0:1787864947.362667:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787864947.362676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087024000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.362937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087024000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.362945:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787864947.363715:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087024000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.363767:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087024128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.363924:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864947.363960:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f0a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.363976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024128 00000100:00100000:3.0:1787864947.363980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024128 00000100:00100000:3.0:1787864947.364016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787864947.364024:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087024128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.364184:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:5846:x1874712087024128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.364191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787864947.364232:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0743acf0-ff0b-46d8-9d09-7d582be6a838:5846:1874712087024128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.364553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864947.364584:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262592 00000100:00100000:0.0:1787864947.364588:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262592 00000100:00100000:0.0:1787864947.364611:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 255 00000100:00100000:0.0:1787864947.364617:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:5595:x1874712071262592:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864947.364634:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864947.364652:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191bcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78e6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.364675:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78e6 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.364685:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78e6 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.364706:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2a600, rc 0) 00000100:00100000:0.0:1787864947.364742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2075fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071262592:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 125us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.364759:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 255 00000040:00080000:1.0:1787864947.367182:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864947.369021:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11683:1874712087024256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864947.369130:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.369173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024256 00000100:00100000:0.0:1787864947.369184:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024256 00000100:00100000:0.0:1787864947.369838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787864947.369853:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:11683:x1874712087024256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864947.370144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864947.370202:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208685c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.370652:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262720 00000100:00100000:3.0:1787864947.370659:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262720 00000100:00100000:0.0:1787864947.370870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:11683:x1874712087024256:12345-0@lo:502:llog_process_th.0 Request processed in 1018us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.371621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 257 00000100:00100000:3.0:1787864947.374429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071262720:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.378445:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071262720:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 6804us (8294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.378500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787864947.378683:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11683:1874712087024256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864947.378729:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864947.378738:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864947.378754:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787864947.378761:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa2100e4000 00000020:00000080:0.0:1787864947.378763:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787864947.379041:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11683:1874712087024384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864947.379089:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.379116:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.379128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024384 00000100:00100000:0.0:1787864947.379132:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024384 00000100:00100000:0.0:1787864947.379156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787864947.379162:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:11683:x1874712087024384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864947.379335:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:11683:x1874712087024384:12345-0@lo:502:llog_process_th.0 Request processed in 172us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.379342:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787864947.379377:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0743acf0-ff0b-46d8-9d09-7d582be6a838:11683:1874712087024384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864947.379394:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864947.379437:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864947.379439:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787864947.379442:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787864947.379768:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787864947.379789:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864947.379806:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.379817:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864947.383192:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 257 00000100:00100000:0.0:1787864947.388559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864947.393929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262848 00000100:00100000:1.0:1787864947.393941:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262848 00000100:00100000:1.0:1787864947.394055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 259 00000100:00100000:1.0:1787864947.394065:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071262848:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.394296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071262848:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 232us (5744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.394304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 259 00000100:00100000:0.0:1787864947.408852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864947.409019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071262976 00000100:00100000:3.0:1787864947.409030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071262976 00000100:00100000:3.0:1787864947.409104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 260 00000100:00100000:3.0:1787864947.409114:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:9952:x1874712071262976:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864947.409903:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:9952:x1874712071262976:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 786us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.409913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 260 00000100:00100000:3.0:1787864947.414018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864947.414543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263104 00000100:00100000:1.0:1787864947.414552:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263104 00000100:00100000:1.0:1787864947.414606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 261 00000100:00100000:1.0:1787864947.414616:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:9952:x1874712071263104:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787864947.415042:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:9952:x1874712071263104:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 426us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.415058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 261 00000100:00100000:1.0:1787864947.430927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864947.431034:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263232 00000100:00100000:3.0:1787864947.431054:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263232 00000100:00100000:3.0:1787864947.431166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 262 00000100:00100000:3.0:1787864947.431177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:5595:x1874712071263232:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864947.431194:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864947.431212:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78ed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.431238:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ed expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.431352:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ed expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.431364:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351e00, rc 0) 00000100:00100000:3.0:1787864947.431460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071263232:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 285us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.431931:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 262 00000100:00100000:0.0:1787864947.437613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864947.437761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263360 00000100:00100000:1.0:1787864947.437771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263360 00000100:00100000:1.0:1787864947.437823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 263 00000100:00100000:1.0:1787864947.437833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071263360:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.438117:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071263360:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 284us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.438125:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 263 00000100:00100000:1.0:1787864947.445036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864947.445388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263488 00000100:00100000:2.0:1787864947.445418:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263488 00000100:00100000:2.0:1787864947.445474:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 264 00000100:00100000:2.0:1787864947.445485:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071263488:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.445995:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:5595:x1874712071263488:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 510us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.446004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 264 00000100:00100000:0.0:1787864947.454917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864947.455063:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263616 00000100:00100000:2.0:1787864947.455073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263616 00000100:00100000:2.0:1787864947.455134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 265 00000100:00100000:2.0:1787864947.455143:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:9955:x1874712071263616:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864947.455361:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:9955:x1874712071263616:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 219us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.455370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 265 00000100:00100000:2.0:1787864947.467925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864947.468145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263744 00000100:00100000:3.0:1787864947.468154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263744 00000100:00100000:3.0:1787864947.468222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 266 00000100:00100000:3.0:1787864947.468233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:9955:x1874712071263744:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864947.468494:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:9955:x1874712071263744:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 263us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.468503:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 266 00000100:00100000:1.0:1787864947.709700:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087024640:0@lo:400:kworker.0 00000100:00100000:1.0:1787864947.709776:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.709882:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087024512:0@lo:400:kworker.0 00000100:00100000:2.0:1787864947.709915:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.709958:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024640 00000100:00100000:2.0:1787864947.709966:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024640 00000100:00100000:2.0:1787864947.710030:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024512 00000100:00100000:2.0:1787864947.710033:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024512 00000100:00100000:2.0:1787864947.710070:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787864947.710079:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864947.710687:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787864947.710698:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864947.710757:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087024512:12345-0@lo:400:kworker.0 Request processed in 50us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.710764:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787864947.710810:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864947.710834:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087024768:0@lo:400:kworker.0 00000100:00100000:0.0:1787864947.710868:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864947.710921:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024768 00000100:00100000:0.0:1787864947.710926:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024768 00000100:00100000:0.0:1787864947.710959:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787864947.710965:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712087024768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864947.711000:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712087024768:12345-0@lo:400:kworker.0 Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.711006:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787864947.711020:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864947.711055:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087024768:0@lo:400:kworker.0 00000100:00100000:0.0:1787864947.711093:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087024512:0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.717565:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087025024:0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.717637:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864947.717698:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864947.717718:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087024896:0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.717759:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864947.717803:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087024896 00000100:00100000:3.0:1787864947.717809:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087024896 00000100:00100000:3.0:1787864947.719204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787864947.719295:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087024896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.719377:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087024896:12345-0@lo:400:kworker.0 Request processed in 163us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.719385:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787864947.719433:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864947.719469:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087024896:0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.719528:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025024 00000100:00100000:3.0:1787864947.719533:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025024 00000100:00100000:3.0:1787864947.719571:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864947.719580:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087025024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864947.719619:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087025024:12345-0@lo:400:kworker.0 Request processed in 41us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.719625:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787864947.719639:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787864947.719660:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa106c34b40 x1874712087025024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864947.719671:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087025024:0@lo:400:kworker.0 00000100:00100000:2.0:1787864947.719863:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087024640:12345-0@lo:400:kworker.0 Request processed in 9783us (10084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.719872:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787864947.720461:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087024640:0@lo:400:kworker.0 00010000:00010000:0.0:1787864947.771586:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864947.875740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864947.875794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864947.875838:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264000 00000100:00100000:0.0:1787864947.875847:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264000 00000100:00100000:3.0:1787864947.875853:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864947.875891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864947.875913:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264256 00000100:00100000:0.0:1787864947.875917:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264256 00000100:00100000:0.0:1787864947.875935:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787864947.875944:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264000:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864947.876004:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264000:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.876016:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787864947.876031:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:0.0:1787864947.876036:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071264256:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864947.876055:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071264256:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 19us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.876072:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00080000:0.0:1787864947.876113:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864947.876366:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264128 00000100:00100000:3.0:1787864947.876370:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264128 00000100:00100000:2.0:1787864947.876443:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071263872 00000100:00100000:3.0:1787864947.876448:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:2.0:1787864947.876451:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071263872 00000100:00100000:3.0:1787864947.876459:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264128:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864947.876489:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 267 00000100:00100000:3.0:1787864947.876500:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264128:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.876502:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071263872:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864947.876514:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00080000:3.0:1787864947.876536:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864947.876555:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071263872:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.876564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 267 00000100:00100000:1.0:1787864948.219899:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087025152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864948.219979:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864948.220349:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025152 00000100:00100000:3.0:1787864948.220358:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025152 00000100:00100000:3.0:1787864948.220465:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864948.220476:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087025152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864948.220511:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864948.220575:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087025152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864948.220583:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787864948.220711:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b820780 x1874712087025152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864948.220752:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087025152:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787864948.414172:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787864948.796444:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864949.821200:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787864950.324179:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1787864950.779744:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087025280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864950.779822:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864950.780123:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025280 00000100:00100000:1.0:1787864950.780132:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025280 00000100:00100000:1.0:1787864950.780231:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864950.780243:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087025280:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864950.780253:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787864950.780278:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864950.780330:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087025280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864950.780354:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864950.780431:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787864950.780437:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa23b821680, transno 4294967300 00000100:00100000:0.0:1787864950.780463:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa106c352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087025280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787864950.843999:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864951.867630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864952.828593:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087025792:0@lo:400:kworker.0 00000100:00100000:1.0:1787864952.828680:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864952.828753:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864952.828760:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087025664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864952.828785:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864952.828990:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025664 00000100:00100000:2.0:1787864952.828999:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025664 00000100:00100000:2.0:1787864952.829070:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864952.829081:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087025664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864952.829136:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087025664:12345-0@lo:400:kworker.0 Request processed in 58us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864952.829146:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787864952.829348:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087025408:0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864952.829433:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087025920:0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864952.829476:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787864952.829482:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087025536:0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829503:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864952.829520:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087026048:0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829541:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864952.829583:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025792 00000100:00100000:3.0:1787864952.829587:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025792 00000100:00100000:3.0:1787864952.829615:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026048 00000100:00100000:3.0:1787864952.829617:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026048 00000100:00100000:3.0:1787864952.829772:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864952.829781:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087025792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829818:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087025792:12345-0@lo:400:kworker.0 Request processed in 39us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864952.829824:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864952.829839:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864952.829846:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087026048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.829877:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087026048:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864952.829883:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864952.829900:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025920 00000100:00100000:3.0:1787864952.829903:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025920 00000100:00100000:3.0:1787864952.829924:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025536 00000100:00100000:3.0:1787864952.829926:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025536 00000100:00100000:3.0:1787864952.829942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787864952.829947:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864952.831335:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787864952.831350:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087025536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864952.831432:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087025536:12345-0@lo:400:kworker.0 Request processed in 87us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864952.831438:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787864952.831462:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864952.831466:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864952.831469:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864952.831498:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087025664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864952.831509:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087025792:0@lo:400:kworker.0 00000100:00100000:0.0:1787864952.831860:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087025536:0@lo:400:kworker.0 00010000:00080000:0.0:1787864952.831875:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23babc3c0 x1874712087026048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864952.831885:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087026048:0@lo:400:kworker.0 00000100:00100000:2.0:1787864952.831987:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087025408 00000100:00100000:2.0:1787864952.831993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087025408 00000100:00100000:2.0:1787864952.832033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787864952.832041:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864952.832109:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087025408:12345-0@lo:400:kworker.0 Request processed in 69us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864952.832115:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787864952.832543:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087025408:0@lo:400:kworker.0 00000100:00100000:3.0:1787864952.834581:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087025920:12345-0@lo:400:kworker.0 Request processed in 4625us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864952.834596:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787864952.836522:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087025920:0@lo:400:kworker.0 00010000:00010000:0.0:1787864952.892951:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864952.999530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864952.999675:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864952.999940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864952.999982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864953.000045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264384 00000100:00100000:3.0:1787864953.000055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264384 00000100:00100000:3.0:1787864953.000125:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 269 00000100:00100000:3.0:1787864953.000135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071264384:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864953.000208:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071264384:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864953.000230:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 269 00000100:00100000:3.0:1787864953.000356:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264640 00000100:00100000:3.0:1787864953.000361:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264640 00000100:00100000:3.0:1787864953.000424:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787864953.000432:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264640:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864953.000466:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264640:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864953.000473:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00080000:3.0:1787864953.000504:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864953.001037:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264512 00000100:00100000:0.0:1787864953.001043:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264512 00000100:00100000:0.0:1787864953.001205:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264768 00000100:00100000:0.0:1787864953.001209:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264768 00000100:00100000:1.0:1787864953.001257:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:1.0:1787864953.001267:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264512:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864953.001316:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071264512:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 50us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864953.001335:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:1.0:1787864953.001352:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:1.0:1787864953.001359:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071264768:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:3.0:1787864953.001366:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864953.001389:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071264768:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864953.001419:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:0.0:1787864953.339746:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864953.339815:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864953.339969:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026176 00000100:00100000:3.0:1787864953.339977:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026176 00000100:00100000:3.0:1787864953.343109:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864953.343135:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087026176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864953.343173:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864953.343266:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864953.343273:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787864953.343482:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b821e00 x1874712087026176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864953.343500:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087026176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787864953.915756:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864954.939887:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864955.900551:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087026304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864955.900630:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864955.900846:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026304 00000100:00100000:3.0:1787864955.900854:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026304 00000100:00100000:3.0:1787864955.900967:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787864955.900983:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087026304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864955.901018:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864955.901085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087026304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864955.901093:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787864955.901172:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864955.901215:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087026304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787864955.963883:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864956.987759:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864957.949934:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087026432:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.950007:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864957.950118:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b7692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087026688:0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.950152:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864957.950204:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864957.950210:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087026816:0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.950230:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864957.950275:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026816 00000100:00100000:2.0:1787864957.950281:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026816 00000100:00100000:2.0:1787864957.950331:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787864957.950339:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b821680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087026816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.950381:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b821680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087026816:12345-0@lo:400:kworker.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864957.950387:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787864957.950429:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864957.950452:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087026816:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.950907:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087026944:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.950937:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864957.950966:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787864957.950973:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087026560:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.950995:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864957.951012:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087027072:0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.951108:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026688 00000100:00100000:2.0:1787864957.951113:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026688 00000100:00100000:2.0:1787864957.951143:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026944 00000100:00100000:2.0:1787864957.951146:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026944 00000100:00100000:2.0:1787864957.951160:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026560 00000100:00100000:2.0:1787864957.951162:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026560 00000100:00100000:2.0:1787864957.951186:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864957.951192:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864957.951232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087026432 00000100:00100000:2.0:1787864957.951233:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087026688:12345-0@lo:400:kworker.0 Request processed in 40us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864957.951240:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087026432 00000100:00100000:2.0:1787864957.951245:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864957.951261:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787864957.951268:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864957.951281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787864957.951293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087026432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.951298:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087026944:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864957.951305:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787864957.951317:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787864957.951340:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087026432:12345-0@lo:400:kworker.0 Request processed in 50us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864957.951347:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1787864957.951393:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864957.951443:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b7692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087026688:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.951523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864957.951554:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087026432:0@lo:400:kworker.0 00000100:00100000:1.0:1787864957.951564:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087026944:0@lo:400:kworker.0 00000100:00100000:3.0:1787864957.951702:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027072 00000100:00100000:3.0:1787864957.951707:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027072 00000100:00100000:3.0:1787864957.951750:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787864957.951757:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087027072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.952126:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087026560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864957.952269:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087027072:12345-0@lo:400:kworker.0 Request processed in 512us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864957.952277:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787864957.952339:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864957.954995:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087026560:0@lo:400:kworker.0 00010000:00080000:3.0:1787864957.955013:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa23b769680 x1874712087027072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864957.955033:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087027072:0@lo:400:kworker.0 00000100:00100000:2.0:1787864957.955272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087026560:12345-0@lo:400:kworker.0 Request processed in 3947us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864957.955283:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:1.0:1787864958.011677:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864958.117924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864958.117974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864958.118054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864958.118105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864958.118149:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265024 00000100:00100000:3.0:1787864958.118162:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265024 00000100:00100000:3.0:1787864958.118249:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265280 00000100:00100000:3.0:1787864958.118252:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265280 00000100:00100000:3.0:1787864958.118281:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:2.0:1787864958.118420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071264896 00000100:00100000:2.0:1787864958.118425:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071264896 00000100:00100000:2.0:1787864958.118457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 271 00000100:00100000:2.0:1787864958.118466:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071264896:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864958.118556:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071264896:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 91us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864958.118564:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 271 00000100:00100000:3.0:1787864958.118915:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071265024:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864958.118955:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071265024:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 48us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864958.119008:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265152 00000100:00100000:1.0:1787864958.119013:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265152 00000100:00100000:1.0:1787864958.119051:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787864958.119058:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071265152:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864958.119085:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071265152:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864958.119091:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787864958.119271:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:0.0:1787864958.119283:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b7692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071265280:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864958.119331:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b7692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071265280:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 52us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864958.119338:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00080000:0.0:1787864958.119380:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864958.119385:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864958.119925:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:1.0:1787864958.459740:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864958.460625:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087027200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864958.460736:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864958.460948:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027200 00000100:00100000:2.0:1787864958.460959:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027200 00000100:00100000:2.0:1787864958.461056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864958.461068:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087027200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864958.461133:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864958.461202:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087027200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864958.461211:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787864958.461357:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f7e3c00 x1874712087027200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864958.461380:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087027200:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787864958.653333:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787864959.036389:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864960.060227:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864961.019876:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864961.020514:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087027328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864961.020582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864961.021582:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027328 00000100:00100000:3.0:1787864961.021592:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027328 00000100:00100000:3.0:1787864961.021960:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787864961.021976:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087027328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864961.022080:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864961.022154:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087027328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864961.022162:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864961.022253:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087027328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787864961.023662:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787864961.083645:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864962.107796:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864963.067599:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087027456:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.067622:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087027840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864963.067707:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087027584:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.068448:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864963.068933:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864963.068945:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087027712:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.068997:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864963.069044:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027840 00000100:00100000:3.0:1787864963.069052:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027840 00000100:00100000:3.0:1787864963.069114:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787864963.069122:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087027840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.069173:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087027840:12345-0@lo:400:kworker.0 Request processed in 53us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.069181:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787864963.069540:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027712 00000100:00100000:3.0:1787864963.069545:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027712 00000100:00100000:3.0:1787864963.069578:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787864963.069587:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.069622:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087027712:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.069628:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787864963.069879:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087027712:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.069891:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087027840:0@lo:400:kworker.0 00000100:00080000:3.0:1787864963.069943:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864963.069948:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864963.076314:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864963.076338:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864963.076377:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027456 00000100:00100000:0.0:1787864963.076385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027456 00000100:00100000:1.0:1787864963.076388:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087028096:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.076432:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027584 00000100:00100000:3.0:1787864963.076437:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027584 00000100:00100000:1.0:1787864963.076443:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864963.076478:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864963.076487:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087027968:0@lo:400:kworker.0 00000100:00100000:3.0:1787864963.076490:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787864963.076525:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864963.076563:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087027584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864963.076593:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087027968 00000100:00100000:2.0:1787864963.076600:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087027968 00000100:00100000:1.0:1787864963.076619:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028096 00000100:00100000:1.0:1787864963.076624:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028096 00000100:00100000:3.0:1787864963.076628:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087027584:12345-0@lo:400:kworker.0 Request processed in 69us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.076636:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787864963.076650:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787864963.076658:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787864963.076672:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087027968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864963.076681:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087028096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787864963.076692:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864963.076699:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864963.076731:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087027968:12345-0@lo:400:kworker.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864963.076740:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087028096:12345-0@lo:400:kworker.0 Request processed in 59us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864963.076743:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787864963.076754:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864963.076797:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087027968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864963.076811:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087027584:0@lo:400:kworker.0 00010000:00080000:1.0:1787864963.076822:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa205894f00 x1874712087028096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864963.076832:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087028096:0@lo:400:kworker.0 00000100:00100000:0.0:1787864963.077043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787864963.077048:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087027456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864963.077191:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087027456:12345-0@lo:400:kworker.0 Request processed in 141us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864963.077199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787864963.077304:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087027456:0@lo:400:kworker.0 00010000:00010000:0.0:1787864963.132316:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864963.235069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864963.235115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864963.235215:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265536 00000100:00100000:0.0:1787864963.235225:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265536 00000100:00100000:0.0:1787864963.235318:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:0.0:1787864963.235329:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071265536:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864963.235443:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071265536:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864963.235450:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:3.0:1787864963.235817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265408 00000100:00100000:3.0:1787864963.235823:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265408 00000100:00100000:3.0:1787864963.235864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00100000:3.0:1787864963.235873:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071265408:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864963.235916:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071265408:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 44us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.235922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00080000:1.0:1787864963.236378:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864963.249162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864963.249297:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265664 00000100:00100000:3.0:1787864963.249306:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265664 00000100:00100000:3.0:1787864963.249381:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787864963.249391:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2355:x1874712071265664:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:3.0:1787864963.249451:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191b10 00000100:00080000:3.0:1787864963.249460:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787864963.249509:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787864963.249858:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+2:2355:x1874712071265664:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 467us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.249866:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00080000:1.0:1787864963.250442:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787864963.250494:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864963.250861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864963.250927:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265792 00000100:00100000:3.0:1787864963.250933:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265792 00000100:00100000:3.0:1787864963.250992:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787864963.251011:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071265792:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864963.251115:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071265792:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864963.251122:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00080000:1.0:1787864963.251370:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864963.581207:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087028224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864963.581290:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864963.581439:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028224 00000100:00100000:2.0:1787864963.581446:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028224 00000100:00100000:2.0:1787864963.581504:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864963.581513:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087028224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864963.581553:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864963.581599:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087028224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864963.581621:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787864963.581762:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f7e0f00 x1874712087028224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864963.581781:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087028224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787864964.155582:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864965.179637:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787864965.674518:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:2.0:1787864965.674526:0:6719:0:(genops.c:885:class_export_put()) final put ffff9fa203fd0000/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:0.0:1787864965.674593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203fd0000/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-OST0000 00000020:00000080:0.0:1787864965.674643:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa203fd1000 for lustre-OST0000 00000100:00100000:0.0:1787864966.145833:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087028352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864966.145900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864966.146100:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028352 00000100:00100000:1.0:1787864966.146107:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028352 00000100:00100000:1.0:1787864966.146164:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787864966.146172:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087028352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864966.146203:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864966.156334:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087028352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10151us (10423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864966.156350:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787864966.156390:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864966.162302:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087028352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864966.204521:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864967.229004:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864968.188352:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864968.188374:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087028736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864968.188480:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864968.188561:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028736 00000100:00100000:2.0:1787864968.188567:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028736 00000100:00100000:2.0:1787864968.188615:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787864968.188624:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087028736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864968.188694:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087028736:12345-0@lo:400:kworker.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864968.188701:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787864968.188743:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087028736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864968.188778:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087028864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864968.188810:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864968.189186:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087028608:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189216:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864968.189245:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087029120:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189275:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864968.189302:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787864968.189307:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087028480:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189330:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864968.189349:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c317840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087028992:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189366:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864968.189392:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028864 00000100:00100000:3.0:1787864968.189416:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028864 00000100:00100000:3.0:1787864968.189447:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029120 00000100:00100000:3.0:1787864968.189450:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029120 00000100:00100000:3.0:1787864968.189472:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787864968.189482:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087028864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189523:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087028864:12345-0@lo:400:kworker.0 Request processed in 45us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.189529:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787864968.189544:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864968.189550:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087029120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189581:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087029120:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.189586:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864968.189604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028480 00000100:00100000:3.0:1787864968.189608:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028480 00000100:00100000:3.0:1787864968.189629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787864968.189646:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087028480:12345-0@lo:400:kworker.0 Request processed in 107us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.189758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787864968.189784:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028608 00000100:00100000:3.0:1787864968.189788:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028608 00000100:00100000:3.0:1787864968.189811:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087028992 00000100:00100000:3.0:1787864968.189814:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087028992 00000100:00100000:3.0:1787864968.189835:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864968.189842:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087028608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189871:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087028608:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.189877:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864968.189888:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787864968.189895:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087028992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189920:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087028992:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.189926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787864968.189965:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087028480:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189975:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c317840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087028992:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.189983:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087028608:0@lo:400:kworker.0 00010000:00080000:3.0:1787864968.189994:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22c317480 x1874712087029120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864968.190004:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087029120:0@lo:400:kworker.0 00000100:00100000:3.0:1787864968.190034:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087028864:0@lo:400:kworker.0 00000100:00080000:1.0:1787864968.190115:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864968.190120:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864968.190122:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864968.252629:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864968.355071:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864968.355112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864968.355152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864968.355232:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266176 00000100:00100000:3.0:1787864968.355254:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266176 00000100:00100000:3.0:1787864968.355323:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266048 00000100:00100000:3.0:1787864968.355327:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266048 00000100:00100000:3.0:1787864968.355363:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:3.0:1787864968.355373:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071266176:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864968.355470:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071266176:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.355477:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:3.0:1787864968.355494:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787864968.355501:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071266048:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864968.355526:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071266048:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864968.355532:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:2.0:1787864968.355885:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071265920 00000100:00100000:2.0:1787864968.355891:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071265920 00000100:00100000:2.0:1787864968.355927:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00100000:2.0:1787864968.355933:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071265920:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864968.355974:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071265920:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 40us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864968.355979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00080000:0.0:1787864968.356337:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864968.699775:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864968.699795:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087029248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864968.699856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864968.700115:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029248 00000100:00100000:0.0:1787864968.700123:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029248 00000100:00100000:0.0:1787864968.700170:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864968.700180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087029248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864968.700214:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864968.700255:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087029248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864968.700262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787864968.700334:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2058970c0 x1874712087029248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864968.700352:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2058970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087029248:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787864968.892255:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787864969.276279:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864969.801953:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:09:28 (1787864968) 00010000:00010000:0.0:1787864970.300673:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864971.259834:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864971.259863:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087029376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864971.260164:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864971.260485:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029376 00000100:00100000:3.0:1787864971.260494:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029376 00000100:00100000:3.0:1787864971.260571:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864971.260582:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087029376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864971.260616:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864971.260690:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087029376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864971.260705:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787864971.260768:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864971.262640:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa205896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087029376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864971.263080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864971.263172:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266304 00000100:00100000:2.0:1787864971.263179:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266304 00000100:00100000:2.0:1787864971.263244:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00080000:0.0:1787864971.263335:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864971.263367:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+5:10224:x1874712071266304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864971.263388:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864971.263439:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78f4 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.263509:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.263525:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.263541:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864971.263762:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787864971.263766:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864971.263860:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.263885:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78f4 expref: 7 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.265105:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78f4 expref: 6 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864971.265120:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:2.0:1787864971.265137:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864971.265141:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581000, rc 0) 00000100:00100000:2.0:1787864971.265223:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+6:10224:x1874712071266304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1970us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864971.265232:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:1.0:1787864971.279375:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864971.279614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266432 00000100:00100000:3.0:1787864971.279633:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266432 00000100:00100000:3.0:1787864971.279698:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787864971.279708:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:10225:x1874712071266432:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864971.279727:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864971.279747:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f78fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279807:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279832:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279845:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279851:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.279858:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280546:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280570:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280578:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864971.280683:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787864971.280687:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864971.280766:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280778:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280784:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280791:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280797:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864971.280802:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280810:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280822:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:3.0:1787864971.280825:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864971.280830:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280846:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280859:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280864:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280869:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280874:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864971.280877:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280883:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.280890:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864971.280893:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864971.281277:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.281288:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191bf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.281325:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78fb expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.281339:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78fb expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864971.281354:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20c8dc700) 00010000:00010000:3.0:1787864971.281357:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864971.281360:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351a00, rc 0) 00000100:00100000:3.0:1787864971.281455:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:10225:x1874712071266432:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1748us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864971.281464:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787864971.291228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864971.291447:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266688 00000100:00100000:1.0:1787864971.291457:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266688 00000100:00100000:1.0:1787864971.291511:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787864971.291520:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:10225:x1874712071266688:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864971.291540:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864971.291562:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191c05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7902 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291641:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291654:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291665:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291724:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291731:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.291737:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292527:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ba00/0xa63eebe186191c1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292551:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ba00/0xa63eebe186191c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292559:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ba00/0xa63eebe186191c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864971.292571:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787864971.292787:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292795:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292801:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292807:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864971.292811:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.292818:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294166:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20c8dc700) 00010000:00010000:1.0:1787864971.294176:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864971.294183:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294192:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186191c0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294210:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294229:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294234:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294239:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864971.294243:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294390:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294542:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa211170a00) 00010000:00010000:1.0:1787864971.294545:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864971.294549:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.294554:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186191c13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.295071:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186191c05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7902 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.295088:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ba00/0xa63eebe186191c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7902 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864971.295095:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:1.0:1787864971.295097:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864971.295105:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ba00, rc 0) 00000100:00100000:1.0:1787864971.295184:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10225:x1874712071266688:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 3664us (3965us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787864971.295192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787864971.302877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864971.305213:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266816 00000100:00100000:3.0:1787864971.305236:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266816 00000100:00100000:3.0:1787864971.305355:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787864971.305369:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10225:x1874712071266816:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787864971.305602:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10225:x1874712071266816:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 236us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864971.305612:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00010000:00010000:0.0:1787864971.338325:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864971.964049:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787864972.350590:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864973.309811:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087029632:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.309878:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.309932:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087030144:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.309974:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.310011:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787864973.310018:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087029504:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.310046:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.310069:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087030016:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.310089:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.310115:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087029760:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.310137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.310156:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864973.310161:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087029888:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.310181:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864973.310222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029632 00000100:00100000:1.0:1787864973.310228:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029632 00000100:00100000:1.0:1787864973.310269:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087030016 00000100:00100000:1.0:1787864973.310272:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087030016 00000100:00100000:1.0:1787864973.310299:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029760 00000100:00100000:1.0:1787864973.310302:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029760 00000100:00100000:1.0:1787864973.310319:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787864973.310327:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.310389:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087029632:12345-0@lo:400:kworker.0 Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.313648:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787864973.313693:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787864973.313712:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087030016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.313806:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087030016:12345-0@lo:400:kworker.0 Request processed in 104us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.313812:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787864973.313825:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787864973.313832:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087029760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.313869:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087029760:12345-0@lo:400:kworker.0 Request processed in 38us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.313874:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787864973.313895:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087030144 00000100:00100000:1.0:1787864973.313902:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087030144 00000100:00100000:1.0:1787864973.313941:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029888 00000100:00100000:1.0:1787864973.313945:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029888 00000100:00100000:1.0:1787864973.313966:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787864973.313972:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087030144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.314005:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087030144:12345-0@lo:400:kworker.0 Request processed in 34us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.314011:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787864973.314022:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787864973.314028:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.314057:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087029888:12345-0@lo:400:kworker.0 Request processed in 30us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.314093:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787864973.314115:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864973.314119:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864973.314122:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864973.314166:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087029888:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.314178:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087029760:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.314228:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087030016:0@lo:400:kworker.0 00000100:00100000:1.0:1787864973.314239:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087029632:0@lo:400:kworker.0 00010000:00080000:1.0:1787864973.314250:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1d70c0 x1874712087030144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864973.314261:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087030144:0@lo:400:kworker.0 00000100:00100000:0.0:1787864973.314564:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087029504 00000100:00100000:0.0:1787864973.314569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087029504 00000100:00100000:0.0:1787864973.314602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787864973.314622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864973.314663:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087029504:12345-0@lo:400:kworker.0 Request processed in 54us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864973.314669:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787864973.318793:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087029504:0@lo:400:kworker.0 00010000:00010000:0.0:1787864973.371908:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864973.483583:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.483631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.483664:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.483699:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071266944 00000100:00100000:1.0:1787864973.483724:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071266944 00000100:00100000:3.0:1787864973.483923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267072 00000100:00100000:3.0:1787864973.483928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267072 00000100:00100000:3.0:1787864973.483961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00100000:3.0:1787864973.483970:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071267072:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864973.484011:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267200 00000100:00100000:1.0:1787864973.484015:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267200 00000100:00100000:3.0:1787864973.484049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071267072:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864973.484058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00100000:0.0:1787864973.489209:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:0.0:1787864973.489230:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071267200:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864973.489319:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071267200:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 97us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864973.489327:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:0.0:1787864973.489355:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:0.0:1787864973.489363:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10267:x1874712071266944:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864973.489376:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864973.489414:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7909 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489498:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489513:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489525:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489539:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489547:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489554:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489807:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489814:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489821:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489827:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2aa00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.489831:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489849:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489861:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787864973.489864:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.489869:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489876:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489887:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489893:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489899:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489904:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ae00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.489906:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489912:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489919:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa20378bd00) 00010000:00010000:0.0:1787864973.489921:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.489924:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489939:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489972:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7909 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489981:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787864973.489984:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.489987:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7909 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.489996:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2ba00, rc 0) 00000100:00100000:0.0:1787864973.490038:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10267:x1874712071266944:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 676us (6463us total) trans 0 rc 301/301 00000100:00100000:0.0:1787864973.490045:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00080000:0.0:1787864973.490083:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864973.499369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.499482:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267456 00000100:00100000:1.0:1787864973.499492:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267456 00000100:00100000:1.0:1787864973.499548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787864973.499559:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10267:x1874712071267456:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:1.0:1787864973.499623:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864973.499656:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191be2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78f4 expref: 9 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.499674:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:1.0:1787864973.499684:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864973.500153:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.500169:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.500181:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.500194:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.500202:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.500208:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864973.504745:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787864973.504773:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504783:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504790:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504796:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.504800:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504816:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504833:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170500) 00010000:00010000:0.0:1787864973.504836:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.504841:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.504847:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864973.504868:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b7234e8 reply state 00000000ea14f2f4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864973.504876:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864973.505109:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+10:10267:x1874712071267456:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 5547us (5745us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787864973.505118:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:2.0:1787864973.509685:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.509702:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.510057:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.510065:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864973.510070:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.510078:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.510094:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa211170b00) 00010000:00010000:2.0:1787864973.510098:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864973.510102:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864973.510109:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864973.642812:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.642878:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267584 00000100:00100000:1.0:1787864973.642887:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267584 00000100:00100000:1.0:1787864973.642949:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787864973.642960:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+9:10275:x1874712071267584:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:1.0:1787864973.642986:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864973.643024:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7910 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643120:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643134:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643146:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864973.643208:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787864973.643217:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864973.643259:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643283:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7910 expref: 11 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643301:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7910 expref: 10 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.643309:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864973.643311:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864973.643315:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031400, rc 0) 00000100:00100000:1.0:1787864973.643373:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+10:10275:x1874712071267584:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 416us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.643381:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787864973.757577:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864973.757786:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267712 00000100:00100000:0.0:1787864973.757795:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267712 00000100:00100000:0.0:1787864973.758020:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:0.0:1787864973.758032:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+10:10281:x1874712071267712:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864973.758051:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864973.758070:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7917 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758126:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758304:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758317:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758335:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758342:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758349:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758502:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758510:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758517:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864973.758719:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787864973.758723:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864973.758768:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758781:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758809:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758816:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758822:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.758827:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758834:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758846:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:0.0:1787864973.758849:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.758854:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758869:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758885:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758892:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758898:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758902:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ae00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.758912:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758919:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758927:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa20378bd00) 00010000:00010000:0.0:1787864973.758930:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.758933:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758939:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758970:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7917 expref: 12 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758983:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7917 expref: 11 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.758991:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864973.758993:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787864973.758995:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2ba00, rc 0) 00000100:00100000:0.0:1787864973.759063:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+11:10281:x1874712071267712:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1032us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864973.759071:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:0.0:1787864973.766522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864973.766581:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071267968 00000100:00100000:2.0:1787864973.766600:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071267968 00000100:00100000:2.0:1787864973.766685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787864973.768930:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+11:10281:x1874712071267968:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864973.768975:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864973.769001:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191c75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f791e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769248:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769264:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769276:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769334:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769343:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.769350:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787864973.772289:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787864973.772638:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772654:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772665:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772708:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772716:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772850:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772857:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864973.772861:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772868:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772883:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:1.0:1787864973.772886:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864973.772891:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.772897:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191c7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864973.772911:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9b0b152 reply state 000000000076d09c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864973.772920:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787864973.773008:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191c75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.773034:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.773043:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:1.0:1787864973.773046:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864973.773048:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031a00, rc 0) 00000100:00100000:1.0:1787864973.773124:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10281:x1874712071267968:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6430us (6614us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787864973.773133:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00010000:00010000:0.0:1787864973.776556:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776592:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776599:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776617:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864973.776621:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776630:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776655:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa211170d00) 00010000:00010000:0.0:1787864973.776659:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864973.776664:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.776671:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191c83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864973.786076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.786715:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268096 00000100:00100000:1.0:1787864973.786725:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268096 00000100:00100000:1.0:1787864973.786815:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:1.0:1787864973.786822:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874712071268096:12345-192.168.206.10@tcp:8:bash.0 00010000:00080000:1.0:1787864973.786856:0:6695:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1787864973.786888:0:6695:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe186191c98 00002000:00100000:1.0:1787864973.786899:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ba0702c-0896-417b-a9c4-527e0244aed4/ffff9fa204dbc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787864973.786921:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787864973.787169:0:6695:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787864973.787209:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9fa204dbf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787864973.787279:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071268096:12345-192.168.206.10@tcp:8:bash.0 Request processed in 455us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.787287:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787864973.796588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864973.796908:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268224 00000100:00100000:0.0:1787864973.796919:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268224 00000100:00100000:0.0:1787864973.797007:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787864973.797018:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:0:x1874712071268224:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864973.797035:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864973.797056:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7925 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864973.797115:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787864973.797134:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=289s v=(0 0) 00010000:00010000:0.0:1787864973.797138:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864973.797153:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.797172:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.797185:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2aa00, rc 0) 00000100:00100000:0.0:1787864973.797679:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:0:x1874712071268224:12345-192.168.206.10@tcp:101:bash.0 Request processed in 661us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864973.797688:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00080000:2.0:1787864973.798295:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864973.810614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864973.810760:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268352 00000100:00100000:3.0:1787864973.810771:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268352 00000100:00100000:3.0:1787864973.810838:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787864973.810849:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:10281:x1874712071268352:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864973.810868:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864973.810887:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f792c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864973.810918:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864973.810927:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864973.810932:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864973.810937:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864973.810984:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864973.810998:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 8 pid: 6694 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864973.811012:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087030272:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864973.811119:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864973.815630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864973.815832:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268480 00000100:00100000:0.0:1787864973.815841:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268480 00010000:00010000:0.0:1787864973.815880:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 9 pid: 6694 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864973.815916:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787864973.815926:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071268480:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864973.815940:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864973.815975:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 9 pid: 6694 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.816005:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 9 pid: 6694 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.816029:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864973.816034:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864973.816042:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.816052:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864973.816087:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864973.816101:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874712087030400:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787864973.816185:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00010000:00010000:1.0:1787864973.816954:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f91696/0xa63eebe186191c9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7925 expref: 9 pid: 6694 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864973.816990:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087030272:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864973.817017:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.817030:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:1.0:1787864973.817073:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:10281:x1874712071268352:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6227us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.817081:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787864973.820519:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864973.820542:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087030528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864973.820646:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864973.820700:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087030528 00000100:00100000:0.0:1787864973.820717:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087030528 00000100:00100000:0.0:1787864973.820761:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787864973.820769:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087030528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864973.820790:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787864973.820839:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087030528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864973.820846:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787864973.820885:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087030528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864973.825893:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874712087030400:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787864973.825920:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864973.825975:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2359:x1874712071268480:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 10049us (10354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864973.825986:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787864973.829192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864973.829328:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268736 00000100:00100000:2.0:1787864973.829339:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268736 00000100:00100000:2.0:1787864973.829428:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787864973.829446:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10281:x1874712071268736:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787864973.830413:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10281:x1874712071268736:12345-192.168.206.10@tcp:35:bash.0 Request processed in 948us (1216us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787864973.830434:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787864973.963541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864973.963686:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071268992 00000100:00100000:1.0:1787864973.963694:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071268992 00000100:00100000:1.0:1787864973.963750:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787864973.963760:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10291:x1874712071268992:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864973.963784:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864973.963804:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7933 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864973.963905:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787864973.964018:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191cad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7933 expref: 16 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.964051:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864973.964054:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864973.964059:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7933 expref: 16 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864973.964074:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031c00, rc 0) 00000100:00100000:1.0:1787864973.964131:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10291:x1874712071268992:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 373us (599us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787864973.964138:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:2.0:1787864973.971247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864973.971320:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071269248 00000100:00100000:3.0:1787864973.971329:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071269248 00000100:00100000:3.0:1787864973.971428:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787864973.971439:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10291:x1874712071269248:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864973.972052:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+16:10291:x1874712071269248:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 244us (444us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787864973.972062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787864974.079314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.079455:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071269376 00000100:00100000:0.0:1787864974.079466:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071269376 00000100:00100000:0.0:1787864974.079529:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787864974.079539:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+16:10298:x1874712071269376:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864974.079561:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.079584:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f793a expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079663:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079677:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079702:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.079762:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787864974.079766:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864974.079790:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079817:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f793a expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079855:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f793a expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.079864:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864974.079868:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864974.079874:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2aa00, rc 0) 00000100:00100000:0.0:1787864974.079935:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10298:x1874712071269376:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 398us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864974.079942:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787864974.095436:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864974.095554:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071269632 00000100:00100000:1.0:1787864974.095563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071269632 00000100:00100000:1.0:1787864974.095639:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787864974.095649:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10298:x1874712071269632:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864974.095669:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864974.095700:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7941 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.095794:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.095808:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.095820:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864974.095831:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787864974.095970:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7941 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.095989:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7941 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.095997:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:1.0:1787864974.096000:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864974.096003:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200030600, rc 0) 00000100:00100000:1.0:1787864974.096062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10298:x1874712071269632:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 415us (675us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787864974.096070:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:2.0:1787864974.105668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.105765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071269888 00000100:00100000:0.0:1787864974.105774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071269888 00000100:00100000:0.0:1787864974.105830:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787864974.105840:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10298:x1874712071269888:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864974.105863:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.105882:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7948 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.105980:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.105994:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.106006:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.106035:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787864974.106167:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186191cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7948 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.106187:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7948 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.106197:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:0.0:1787864974.106200:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864974.106204:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2ae00, rc 0) 00000100:00100000:0.0:1787864974.106260:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10298:x1874712071269888:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 421us (600us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787864974.106268:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787864974.107868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.107936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270016 00000100:00100000:3.0:1787864974.107953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270016 00000100:00100000:3.0:1787864974.108007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787864974.108016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:2356:x1874712071270016:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864974.108030:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864974.108050:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7941 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.108068:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:3.0:1787864974.108072:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864974.108125:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+20:2356:x1874712071270016:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864974.108133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787864974.125600:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.125710:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270144 00000100:00100000:0.0:1787864974.125719:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270144 00000100:00100000:0.0:1787864974.125780:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787864974.125789:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071270144:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:0.0:1787864974.125832:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.125852:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.125860:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787864974.125864:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864974.125868:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.125912:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.125927:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 7 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.125952:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1874712087030656:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864974.126048:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51480 going to sleep for 11 seconds 00000100:00100000:3.0:1787864974.134072:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1874712087030656:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864974.134109:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864974.134882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.134979:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270272 00000100:00100000:0.0:1787864974.134987:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270272 00002000:00100000:0.0:1787864974.135029:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9fa21015b480 x1874712071270272/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:70/0 lens 504/0 e 0 to 0 dl 1787864985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864974.135040:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa21015b480 with x1874712071270272 ext(0->12) 00010000:00010000:0.0:1787864974.135048:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 8 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.135063:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 8 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864974.135070:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa21015b480 00000100:00100000:0.0:1787864974.135120:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787864974.135130:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071270272:12345-192.168.206.10@tcp:4:lfs.0 00000001:00100000:2.0:1787864974.256802:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000100:00100000:1.0:1787864974.258882:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2358:x1874712071270272:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 123746us (123995us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787864974.258900:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:1.0:1787864974.258914:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9fa21015b480 x1874712071270272/t4294967299(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:70/0 lens 504/448 e 0 to 0 dl 1787864985 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787864974.258925:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa21015b480 with x1874712071270272 ext(0->12) 00010000:00010000:1.0:1787864974.259513:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.259539:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864974.259548:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa21015b480 00000100:00100000:0.0:1787864974.265224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864974.265314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270400 00000100:00100000:2.0:1787864974.265324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270400 00010000:00010000:2.0:1787864974.265360:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864974.265434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787864974.265454:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071270400:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864974.265469:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787864974.265486:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787864974.265490:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787864974 00002000:00010000:2.0:1787864974.265492:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787864974 00002000:00010000:2.0:1787864974.265507:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787864974 00010000:00010000:2.0:1787864974.265514:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.265528:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.265555:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186191ca6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f792c expref: 9 pid: 6696 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.265640:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864974.265645:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864974.265651:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.265661:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.265824:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864974.265880:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071270400:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 437us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864974.265888:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00010000:00010000:3.0:1787864974.279384:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279463:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279507:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279517:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279526:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279534:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864974.279539:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279547:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279581:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.279591:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c759626d/0xa63eebe186191cf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864974.279731:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071270144:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 153938us (154136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864974.279742:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787864974.292526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.293032:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270656 00000100:00100000:3.0:1787864974.293043:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270656 00000100:00100000:3.0:1787864974.293104:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787864974.293115:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:10298:x1874712071270656:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:3.0:1787864974.293175:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7948 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864974.293710:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787864974.293769:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787864974.298896:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787864974.298990:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.299009:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.299028:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.299062:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.299077:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 24 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864974.299091:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c314780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087030784:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864974.299185:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207dff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864974.302570:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c314780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087030784:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864974.302624:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864974.303209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.303302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270784 00000100:00100000:3.0:1787864974.303310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270784 00010000:00010000:3.0:1787864974.303350:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 25 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864974.303385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787864974.303421:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+25:2358:x1874712071270784:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864974.303439:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864974.303455:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 25 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303470:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 25 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303507:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f791e expref: 25 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303524:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:3.0:1787864974.303530:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303539:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303546:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.303577:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864974.303642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:2358:x1874712071270784:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 249us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864974.303650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:2.0:1787864974.304871:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.304883:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864974.305012:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787864974.305205:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787864974.305347:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c3161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087030912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864974.306224:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864974.306262:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210cca180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864974.306688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087030912 00000100:00100000:1.0:1787864974.306696:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087030912 00000100:00100000:1.0:1787864974.306744:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864974.306753:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087030912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787864974.306855:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087030912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864974.306863:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864974.307013:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c3161c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087030912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787864974.308127:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787864974.308285:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087031040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864974.308336:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864974.308358:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207dffb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864974.308787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087031040 00000100:00100000:1.0:1787864974.308793:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087031040 00000100:00100000:1.0:1787864974.308839:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864974.308847:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087031040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787864974.309028:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874712087031040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (691us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787864974.309036:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864974.311090:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087031040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787864974.311192:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787864974.311251:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311261:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311267:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311273:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.311277:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311284:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311298:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:0.0:1787864974.311301:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787864974.311306:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.311311:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186191cfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864974.311854:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787864974.312091:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787864974.312103:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290251705358ns, next at 291251703354ns, rc = 0 00000001:00080000:0.0:1787864974.312109:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787864974.312146:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170700) 00010000:00010000:0.0:1787864974.312150:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864974.312157:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe186191ce5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7948 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.313853:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+27:10298:x1874712071270656:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 20731us (21328us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787864974.313884:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000020:00080000:0.0:1787864974.313891:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787864974.321559:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864974.321744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071270912 00000100:00100000:1.0:1787864974.321754:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071270912 00000100:00100000:1.0:1787864974.321830:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787864974.321841:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+27:10298:x1874712071270912:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864974.321868:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864974.321892:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f794f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.321960:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f794f expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.322010:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f794f expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864974.322043:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:1.0:1787864974.322046:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864974.322050:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031c00, rc 0) 00000100:00100000:1.0:1787864974.322128:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+28:10298:x1874712071270912:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 288us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864974.322144:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787864974.330721:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.331386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071271168 00000100:00100000:0.0:1787864974.331452:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071271168 00000100:00100000:0.0:1787864974.331518:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787864974.331528:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+28:10298:x1874712071271168:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787864974.331770:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10298:x1874712071271168:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 242us (1059us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787864974.331778:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00010000:00010000:0.0:1787864974.395695:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864974.453749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.453850:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071271424 00000100:00100000:0.0:1787864974.453861:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071271424 00000100:00100000:0.0:1787864974.453925:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787864974.453935:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10308:x1874712071271424:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864974.453958:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.453992:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7956 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.454119:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787864974.454246:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7956 expref: 31 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.454260:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:0.0:1787864974.454263:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864974.454268:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7956 expref: 31 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.454283:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493200, rc 0) 00000100:00100000:0.0:1787864974.454344:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10308:x1874712071271424:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 410us (606us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787864974.454351:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787864974.457846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.457946:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071271552 00000100:00100000:0.0:1787864974.457956:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071271552 00000100:00100000:0.0:1787864974.458016:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787864974.458027:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10308:x1874712071271552:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787864974.458105:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458122:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458134:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458167:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458175:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458183:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458293:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458302:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458309:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864974.458349:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458362:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458369:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458375:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458381:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.458385:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458426:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458451:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864974.458455:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864974.458459:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458465:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458479:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458485:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458491:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458496:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.458498:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458504:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458511:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864974.458514:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864974.458516:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458531:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458547:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458552:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458558:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458563:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.458566:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458572:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458580:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864974.458582:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864974.458585:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.458590:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.459806:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10308:x1874712071271552:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 652us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864974.459824:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787864974.461791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.461968:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071271808 00000100:00100000:3.0:1787864974.461976:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071271808 00000100:00100000:3.0:1787864974.462030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787864974.462040:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10308:x1874712071271808:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864974.462464:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+31:10308:x1874712071271808:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 424us (678us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787864974.462472:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787864974.506699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.507144:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071272064 00000100:00100000:0.0:1787864974.507157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071272064 00000100:00100000:0.0:1787864974.507282:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787864974.507295:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+31:10311:x1874712071272064:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864974.507320:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.507343:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f795d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507461:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507476:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507499:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507515:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507523:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507530:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507675:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507684:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507708:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.507719:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787864974.507815:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507823:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507830:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507835:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.507840:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507848:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507862:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864974.507866:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864974.507870:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507877:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507890:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507896:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507908:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507914:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.507917:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507924:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507933:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864974.507935:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864974.507938:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507944:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe186191d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.507988:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.508002:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.508009:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864974.508011:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864974.508014:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493200, rc 0) 00000100:00100000:0.0:1787864974.508070:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10311:x1874712071272064:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 778us (1379us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787864974.508100:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787864974.519337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.519467:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071272192 00000100:00100000:0.0:1787864974.519477:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071272192 00000100:00100000:0.0:1787864974.519523:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787864974.519535:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10311:x1874712071272192:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787864974.519624:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519644:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519657:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519684:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519690:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519696:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519702:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864974.519706:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519713:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519724:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864974.519739:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864974.519745:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.519752:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.519834:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10311:x1874712071272192:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 301us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864974.519842:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787864974.526336:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.526434:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071272448 00000100:00100000:3.0:1787864974.526446:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071272448 00000100:00100000:3.0:1787864974.526514:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787864974.526539:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10311:x1874712071272448:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864974.526963:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+34:10311:x1874712071272448:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 426us (638us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787864974.526973:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787864974.840324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.843726:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071272704 00000100:00100000:0.0:1787864974.843739:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071272704 00000100:00100000:0.0:1787864974.843804:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787864974.843815:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+34:10342:x1874712071272704:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787864974.843838:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.843858:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7964 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.843954:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.843968:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.843980:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.843991:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787864974.844173:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191d55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7964 expref: 37 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.844200:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7964 expref: 36 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.844209:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864974.844212:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864974.844216:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493400, rc 0) 00000100:00100000:0.0:1787864974.846527:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+36:10342:x1874712071272704:12345-192.168.206.10@tcp:101:cat.0 Request processed in 2702us (6201us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787864974.846539:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787864974.862347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864974.862423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.862504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071273088 00000100:00100000:3.0:1787864974.862513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071273088 00000100:00100000:3.0:1787864974.862577:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787864974.862588:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:2356:x1874712071273088:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864974.862612:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864974.862637:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe186191d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7964 expref: 36 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.862656:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:3.0:1787864974.862662:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864974.862715:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:2356:x1874712071273088:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864974.862723:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787864974.862857:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071272960 00000100:00100000:2.0:1787864974.862861:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071272960 00000100:00100000:2.0:1787864974.862894:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787864974.862902:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:10342:x1874712071272960:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:2.0:1787864974.863097:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:10342:x1874712071272960:12345-192.168.206.10@tcp:35:cat.0 Request processed in 195us (759us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787864974.863104:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787864974.930769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.930822:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071273344 00000100:00100000:0.0:1787864974.930832:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071273344 00000100:00100000:0.0:1787864974.930889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787864974.930900:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+36:10348:x1874712071273344:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787864974.930921:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864974.930924:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864974.930949:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe186191cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f793a expref: 36 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.930971:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864974.930976:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864974.930990:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f796b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.931091:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.931123:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.931131:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.931162:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.931177:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 36 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.931191:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087031168:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864974.931345:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207dff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864974.938277:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087031168:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864974.938321:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864974.940006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864974.940238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071273472 00000100:00100000:3.0:1787864974.940249:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071273472 00010000:00010000:3.0:1787864974.940306:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 37 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864974.940354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787864974.940365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+37:2358:x1874712071273472:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864974.940384:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864974.940447:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 37 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940480:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 37 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940508:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe186191d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f795d expref: 37 pid: 5850 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940529:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:3.0:1787864974.940536:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940556:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940566:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864974.940608:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864974.940679:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+36:2358:x1874712071273472:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 316us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864974.940688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00010000:00010000:0.0:1787864974.940943:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.940954:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864974.940990:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787864974.941236:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.941260:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.941269:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864974.941282:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787864974.941285:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493e00, rc 0) 00000100:00100000:0.0:1787864974.941337:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+36:10348:x1874712071273344:12345-192.168.206.10@tcp:101:dd.0 Request processed in 10439us (10580us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787864974.941346:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787864974.950687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864974.950808:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071273728 00000100:00100000:0.0:1787864974.950822:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071273728 00000100:00100000:0.0:1787864974.951100:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787864974.951113:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:10348:x1874712071273728:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:0.0:1787864974.951806:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.951828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864974.951908:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864974.952104:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787864974.952142:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000946acf41 reply state 000000005e314989 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864974.952154:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864974.952654:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+39:10348:x1874712071273728:12345-192.168.206.10@tcp:36:dd.0 Request processed in 1539us (1977us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787864974.952664:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000020:00080000:0.0:1787864974.952671:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787864974.969500:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969522:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969530:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969537:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864974.969615:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969627:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969651:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:2.0:1787864974.969654:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864974.969660:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864974.969693:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492a00/0xa63eebe186191d7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864975.187579:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.187805:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071273856 00000100:00100000:0.0:1787864975.187817:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071273856 00000100:00100000:0.0:1787864975.187919:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787864975.187962:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+38:10362:x1874712071273856:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:0.0:1787864975.188001:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864975.188031:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7972 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188118:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188137:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188153:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188170:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188178:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188184:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188305:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188317:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188326:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188379:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.188447:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 39 pid: 5850 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864975.188464:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087031296:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864975.188612:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208685c00 going to sleep for 11 seconds 00000100:00080000:2.0:1787864975.188692:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864975.193870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864975.194029:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071274112 00000100:00100000:2.0:1787864975.194041:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071274112 00000100:00100000:2.0:1787864975.194119:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787864975.194131:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+40:5592:x1874712071274112:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787864975.194913:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+41:5592:x1874712071274112:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 781us (1054us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787864975.194924:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787864975.195710:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087031296:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864975.195746:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864975.197199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864975.197425:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071274240 00000100:00100000:2.0:1787864975.197434:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071274240 00010000:00010000:2.0:1787864975.197481:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 41 pid: 5850 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864975.197649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787864975.197661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+41:2358:x1874712071274240:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864975.197678:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864975.197686:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 41 pid: 5850 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197701:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 41 pid: 5850 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191d71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f796b expref: 41 pid: 5850 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197769:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:2.0:1787864975.197774:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197786:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197794:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.197830:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864975.197900:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+40:2358:x1874712071274240:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 240us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864975.197908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00010000:00010000:0.0:1787864975.197933:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.197943:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864975.198718:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787864975.198726:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864975.198780:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198798:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198808:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198816:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198823:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198853:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.198858:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198867:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198881:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864975.198884:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.198889:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198896:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198910:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198917:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198923:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198929:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.198932:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198939:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198958:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864975.198961:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.198974:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.198980:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.199028:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7972 expref: 40 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.199043:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7972 expref: 39 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.199050:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.199053:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864975.199055:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492600, rc 0) 00000100:00100000:0.0:1787864975.199112:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+39:10362:x1874712071273856:12345-192.168.206.10@tcp:101:stat.0 Request processed in 11155us (11548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864975.199121:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787864975.264524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.264643:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071274496 00000100:00100000:0.0:1787864975.264656:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071274496 00000100:00100000:0.0:1787864975.264735:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787864975.264746:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+39:10368:x1874712071274496:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:0.0:1787864975.264822:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864975.264863:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7972 expref: 39 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.264914:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.264920:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864975.265213:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.265230:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.265241:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864975.265299:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787864975.265329:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1bb7968 reply state 0000000094d3cf51 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864975.265340:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864975.265684:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+41:10368:x1874712071274496:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 937us (1172us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787864975.265692:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000020:00080000:0.0:1787864975.265699:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787864975.268704:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268726:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268735:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268742:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.268768:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268779:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268800:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.268804:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.268809:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.268817:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864975.394234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.394671:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071274624 00000100:00100000:0.0:1787864975.394684:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071274624 00000100:00100000:0.0:1787864975.395137:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:0.0:1787864975.395152:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+40:10382:x1874712071274624:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:0.0:1787864975.395184:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864975.395209:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7979 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395313:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395330:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395343:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395358:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395382:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395564:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395696:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395706:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395714:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864975.395758:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787864975.395764:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864975.395792:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395807:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395815:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395822:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395829:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395847:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.395852:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395860:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395874:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864975.395878:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.395883:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395890:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395906:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395912:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395918:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.395924:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.395927:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396229:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396249:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864975.396252:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.396256:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396262:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396318:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191da9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396333:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.396341:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.396344:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864975.396346:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492800, rc 0) 00000100:00100000:0.0:1787864975.396774:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+41:10382:x1874712071274624:12345-192.168.206.10@tcp:101:stat.0 Request processed in 1624us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864975.396785:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00010000:00010000:0.0:1787864975.419717:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864975.497203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.498043:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071274880 00000100:00100000:0.0:1787864975.498058:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071274880 00000100:00100000:1.0:1787864975.498373:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787864975.498428:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+41:10392:x1874712071274880:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864975.498457:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864975.498483:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7980 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864975.498652:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787864975.498807:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191dc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7980 expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.498824:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864975.498828:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864975.498834:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7980 expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.498854:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200030600, rc 0) 00000100:00100000:1.0:1787864975.498951:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+42:10392:x1874712071274880:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 527us (1762us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787864975.498959:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:3.0:1787864975.502602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864975.502806:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071275136 00000100:00100000:2.0:1787864975.502819:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071275136 00000100:00100000:2.0:1787864975.502898:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787864975.502910:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+42:10392:x1874712071275136:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864975.505191:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+43:10392:x1874712071275136:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 2270us (2597us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787864975.505209:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787864975.586379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864975.586730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071275392 00000100:00100000:1.0:1787864975.586743:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071275392 00000100:00100000:1.0:1787864975.587047:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787864975.587059:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+43:10398:x1874712071275392:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864975.587090:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864975.587115:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191dd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7987 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.587336:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.587370:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.587381:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.587520:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.587536:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 44 pid: 5849 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864975.587625:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087031424:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864975.587786:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864975.593651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864975.593717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071275520 00000100:00100000:3.0:1787864975.593728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071275520 00010000:00010000:3.0:1787864975.593785:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 45 pid: 5849 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864975.593797:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087031424:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864975.593853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:3.0:1787864975.593865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+45:2359:x1874712071275520:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864975.593885:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864975.593893:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 45 pid: 5849 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593906:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 45 pid: 5849 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593935:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7979 expref: 45 pid: 5849 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593955:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:1.0:1787864975.593957:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593960:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593971:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593978:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.593996:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864975.594084:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.594091:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864975.594113:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:3.0:1787864975.594130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+44:2359:x1874712071275520:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 267us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864975.594138:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00010000:00010000:1.0:1787864975.594682:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191dd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.594721:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.594729:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:1.0:1787864975.594732:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864975.594735:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031600, rc 0) 00000100:00100000:1.0:1787864975.594770:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+44:10398:x1874712071275392:12345-192.168.206.10@tcp:101:bash.0 Request processed in 7715us (8406us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787864975.594778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787864975.599953:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.601052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071275776 00000100:00100000:0.0:1787864975.601067:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071275776 00000100:00100000:0.0:1787864975.601202:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:0.0:1787864975.601223:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+44:10398:x1874712071275776:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787864975.601682:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.601702:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.601716:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864975.601779:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787864975.601821:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000038bef55 reply state 00000000034f9160 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864975.601832:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864975.601981:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10398:x1874712071275776:12345-192.168.206.10@tcp:36:bash.0 Request processed in 766us (2042us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787864975.601990:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000020:00080000:0.0:1787864975.601996:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787864975.605825:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605848:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605857:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605864:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.605870:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605879:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605920:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.605923:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.605930:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.605937:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864975.608860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864975.609249:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071275904 00000100:00100000:1.0:1787864975.609277:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071275904 00000100:00100000:1.0:1787864975.609374:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:1.0:1787864975.609391:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+46:10398:x1874712071275904:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864975.609479:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864975.609522:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191def lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f798e expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.610110:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.610130:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.610139:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.610182:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.610216:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 47 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864975.610235:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087031552:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864975.611219:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446000 going to sleep for 11 seconds 00000100:00100000:1.0:1787864975.614356:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087031552:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864975.614437:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864975.620258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864975.621081:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071276032 00000100:00100000:1.0:1787864975.621097:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071276032 00010000:00010000:1.0:1787864975.623692:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 48 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864975.623939:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787864975.623966:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+48:2356:x1874712071276032:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864975.623993:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864975.624002:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 48 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624019:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 48 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624049:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7987 expref: 48 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624100:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:1.0:1787864975.624106:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624117:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624126:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.624161:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864975.624255:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+47:2356:x1874712071276032:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 304us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864975.624276:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00010000:00010000:3.0:1787864975.624360:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.624370:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864975.624455:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787864975.624461:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864975.624489:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.624525:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186191def lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f798e expref: 47 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.624545:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f798e expref: 46 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864975.624554:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:3.0:1787864975.624557:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864975.624559:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031a00, rc 0) 00000100:00100000:3.0:1787864975.624589:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+46:10398:x1874712071275904:12345-192.168.206.10@tcp:101:bash.0 Request processed in 15205us (15742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864975.624607:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787864975.628168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864975.628378:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071276288 00000100:00100000:3.0:1787864975.628390:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071276288 00000100:00100000:3.0:1787864975.628616:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787864975.628629:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+46:10398:x1874712071276288:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787864975.628981:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10398:x1874712071276288:12345-192.168.206.10@tcp:35:bash.0 Request processed in 354us (826us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787864975.628989:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787864975.705492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864975.705709:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071276544 00000100:00100000:1.0:1787864975.705721:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071276544 00000100:00100000:1.0:1787864975.705792:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787864975.705803:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10408:x1874712071276544:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864975.705846:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864975.705872:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864975.708270:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787864975.708718:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7995 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.708739:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864975.708760:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864975.708767:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7995 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.708787:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031600, rc 0) 00000100:00100000:1.0:1787864975.708905:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+48:10408:x1874712071276544:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3102us (3424us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787864975.708916:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787864975.714178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.714666:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071276672 00000100:00100000:0.0:1787864975.714678:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071276672 00000100:00100000:0.0:1787864975.714753:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787864975.714766:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+48:10408:x1874712071276672:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787864975.714991:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715012:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715026:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715043:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715050:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715056:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715201:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715620:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715633:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864975.715687:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715702:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715709:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715718:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715725:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.715730:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715739:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715754:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864975.715757:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.715763:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715781:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715800:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715806:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715824:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715830:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.715943:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715952:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715961:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864975.715963:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.715967:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715973:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.715997:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.716010:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.716016:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.716019:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.716025:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.716033:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.716035:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.716038:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.716045:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864975.716159:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+48:10408:x1874712071276672:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1392us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864975.716170:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787864975.718775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864975.719172:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071276928 00000100:00100000:2.0:1787864975.719185:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071276928 00000100:00100000:2.0:1787864975.719254:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787864975.720223:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+48:10408:x1874712071276928:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864975.720805:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10408:x1874712071276928:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 590us (2039us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787864975.720816:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787864975.762772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864975.763936:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071277184 00000100:00100000:1.0:1787864975.763954:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071277184 00000100:00100000:0.0:1787864975.764182:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787864975.764195:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10411:x1874712071277184:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864975.764226:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864975.764253:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f799c expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764349:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764384:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764418:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764436:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764443:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764450:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764741:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764751:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764759:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864975.764771:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787864975.764970:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764978:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764985:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.764999:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.765005:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765013:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765028:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864975.765031:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.765037:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765043:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765060:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765066:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765073:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765079:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864975.765082:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765088:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765108:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b700) 00010000:00010000:0.0:1787864975.765110:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864975.765113:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765120:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765172:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f799c expref: 52 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765188:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f799c expref: 51 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.765196:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.765199:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864975.765202:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493c00, rc 0) 00000100:00100000:0.0:1787864975.765769:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10411:x1874712071277184:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1573us (3009us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787864975.765781:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:3.0:1787864975.772093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.773711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071277312 00000100:00100000:0.0:1787864975.773728:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071277312 00000100:00100000:1.0:1787864975.773734:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.773821:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787864975.773834:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+51:2356:x1874712071277312:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864975.773856:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864975.773888:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f799c expref: 51 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.773933:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.773940:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864975.774014:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:2356:x1874712071277312:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 182us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864975.774022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787864975.774188:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071277440 00000100:00100000:2.0:1787864975.774194:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071277440 00000100:00100000:2.0:1787864975.774236:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787864975.774244:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+50:10411:x1874712071277440:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787864975.774319:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774336:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774348:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774381:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774388:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774421:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774428:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864975.774433:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774455:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774466:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:2.0:1787864975.774469:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864975.774473:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.774479:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864975.774539:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+50:10411:x1874712071277440:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 295us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864975.774546:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:1.0:1787864975.780794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864975.781072:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071277696 00000100:00100000:3.0:1787864975.781085:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071277696 00000100:00100000:3.0:1787864975.781205:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787864975.781230:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:10411:x1874712071277696:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864975.782702:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10411:x1874712071277696:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 1478us (1911us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787864975.782716:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787864975.961217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.961572:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071277952 00000100:00100000:0.0:1787864975.961585:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071277952 00000100:00100000:0.0:1787864975.961664:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787864975.961676:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10429:x1874712071277952:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787864975.961708:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864975.961735:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79a3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.961857:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.961874:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.961888:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864975.961901:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787864975.962170:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186191e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79a3 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.962191:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79a3 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.962229:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:0.0:1787864975.962234:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787864975.962238:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493000, rc 0) 00000100:00100000:0.0:1787864975.962617:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+53:10429:x1874712071277952:12345-192.168.206.10@tcp:101:cat.0 Request processed in 941us (1417us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787864975.962626:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000001:00080000:0.0:1787864975.971199:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:0.0:1787864975.971261:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787864975.971292:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa22564f540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787864975.971299:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa23bc2c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa22564f600 00000020:00080000:0.0:1787864975.971302:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa23bc2c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa23b089400 00000020:00080000:2.0:1787864975.971350:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000001:00080000:0.0:1787864975.971360:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000020:00080000:2.0:1787864975.971500:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787864975.972059:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087031680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787864975.972149:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864975.972235:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087031680 00000100:00100000:0.0:1787864975.972244:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087031680 00000100:00100000:0.0:1787864975.972316:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787864975.972328:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712087031680:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787864975.972360:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787864975.972362:0:6695:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787864975.972615:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a90a78e, atime: 0x6a90a78e, ctime: 0x6a90a78e, blocks: 0x1 00010000:00010000:0.0:1787864975.972626:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.972644:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1787864975.972649:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864975.972657:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.972699:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.972711:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.972720:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.972738:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787864975.973626:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864975.973637:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.973650:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864975.973655:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.973666:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.973690:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.973697:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5bf9292/0xa63eebe186191e5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864975.973731:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864975.973733:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864975.973735:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864975.973756:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1874712087031680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1427us (1604us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787864975.973766:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1787864975.973810:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22ea35e00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787864975.973817:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087031680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787864975.992933:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864975.993005:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278080 00000100:00100000:0.0:1787864975.993019:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278080 00000100:00100000:0.0:1787864975.993095:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787864975.993107:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10430:x1874712071278080:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864975.993137:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864975.993164:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79aa expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.993248:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.993267:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864975.993303:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864975.994203:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787864975.994984:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864975.995139:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.995201:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79aa expref: 15 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.995521:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79aa expref: 14 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864975.995533:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:2.0:1787864975.995536:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864975.995540:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492200, rc 0) 00000100:00100000:2.0:1787864975.995645:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10430:x1874712071278080:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2539us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864975.995655:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787864976.000276:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.000807:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278464 00000100:00100000:2.0:1787864976.000820:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278464 00000100:00100000:2.0:1787864976.000892:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787864976.000905:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10430:x1874712071278464:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864976.001710:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10430:x1874712071278464:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 804us (1444us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787864976.001721:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787864976.004686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.004928:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278592 00000100:00100000:2.0:1787864976.004996:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278592 00000100:00100000:2.0:1787864976.005128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787864976.005141:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10430:x1874712071278592:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:2.0:1787864976.005162:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787864976.005194:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f798e expref: 15 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.005242:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79a3 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.005256:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f794f expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.005280:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170200) 00010000:00010000:2.0:1787864976.005293:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864976.005366:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10430:x1874712071278592:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 227us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.005375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:3.0:1787864976.007590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864976.007897:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278720 00000100:00100000:1.0:1787864976.007908:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278720 00000100:00100000:1.0:1787864976.007982:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:1.0:1787864976.007993:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10430:x1874712071278720:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:1.0:1787864976.008125:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.008146:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.008160:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787864976.008956:0:10329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864976.009184:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787864976.009259:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787864976.009857:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10430:x1874712071278720:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 1860us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864976.009869:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787864976.039452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.039505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278848 00000100:00100000:0.0:1787864976.039514:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278848 00000100:00100000:0.0:1787864976.039572:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:0.0:1787864976.039582:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10432:x1874712071278848:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864976.039611:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864976.039643:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191e7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039717:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039734:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039746:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039761:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039769:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.039776:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040097:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040114:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040122:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864976.040158:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787864976.040162:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864976.040177:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040188:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040196:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040202:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040208:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040214:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.040218:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040226:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040238:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864976.040241:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864976.040251:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040259:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe186191e82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040272:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040279:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040284:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040290:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.040293:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040298:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040306:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378b800) 00010000:00010000:0.0:1787864976.040309:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864976.040312:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040317:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040348:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191e7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040374:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.040382:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:0.0:1787864976.040384:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864976.040387:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492000, rc 0) 00000100:00100000:0.0:1787864976.040501:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10432:x1874712071278848:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 919us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864976.040509:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000040:00080000:1.0:1787864976.059760:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864976.059773:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864976.059829:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787864976.059837:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864976.060017:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea36d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087031808:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864976.060794:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446600 going to sleep for 11 seconds 00000100:00100000:1.0:1787864976.073827:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea36d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087031808:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864976.075697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.078541:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071278976 00000100:00100000:0.0:1787864976.078555:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071278976 00000100:00100000:0.0:1787864976.078635:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787864976.078646:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071278976:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787864976.078735:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071278976:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 90us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864976.078745:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787864976.093140:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.093525:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071279104 00000100:00100000:2.0:1787864976.093537:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071279104 00000100:00100000:2.0:1787864976.093626:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787864976.093639:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071279104:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864976.093682:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864976.093816:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071279104:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 178us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.093824:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:3.0:1787864976.099927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864976.100849:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071279232 00000100:00100000:1.0:1787864976.100862:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071279232 00000100:00100000:1.0:1787864976.100938:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787864976.100951:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071279232:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787864976.101040:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101060:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101076:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101798:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101820:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101832:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101868:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101876:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101883:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864976.101941:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787864976.101946:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864976.101960:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101971:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101978:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101984:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.101990:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864976.101994:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102001:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102013:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:1.0:1787864976.102016:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864976.102020:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102027:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186191e97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102043:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102057:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102062:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102067:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864976.102070:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102077:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102084:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fa211170d00) 00010000:00010000:1.0:1787864976.102087:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864976.102090:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102096:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191e9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102111:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102116:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102122:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.102126:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864976.102135:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.103436:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.103458:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:1.0:1787864976.103461:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864976.103466:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.103472:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864976.103570:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071279232:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 2618us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864976.103608:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787864976.111715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.111884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071279488 00000100:00100000:0.0:1787864976.111893:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071279488 00000100:00100000:0.0:1787864976.111992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:0.0:1787864976.112003:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071279488:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864976.112023:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864976.112041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191eac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112153:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112180:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112192:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864976.112204:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787864976.112299:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112306:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112312:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112318:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.112321:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112328:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112340:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:0.0:1787864976.112343:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864976.112347:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112353:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112464:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191eac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b8 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112484:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:0.0:1787864976.112486:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864976.112491:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191eac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b8 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.112501:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492800, rc 0) 00000100:00100000:0.0:1787864976.112550:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071279488:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 550us (845us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787864976.112558:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787864976.115840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.127770:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071279616 00000100:00100000:2.0:1787864976.127784:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071279616 00000100:00100000:2.0:1787864976.127875:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787864976.127886:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071279616:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864976.127920:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864976.128020:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071279616:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 135us (12187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.128049:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787864976.146851:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.147332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071279872 00000100:00100000:2.0:1787864976.147346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071279872 00000100:00100000:2.0:1787864976.147454:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787864976.147465:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071279872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864976.147481:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864976.147484:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864976.147507:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79aa expref: 14 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.147526:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:2.0:1787864976.147530:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864976.147542:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191ec1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864976.151790:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787864976.152032:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186191ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.152049:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186191ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.152060:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186191ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.152118:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191ec1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79bf expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.152160:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186191ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79bf expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.152169:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa206f51c00) 00010000:00010000:2.0:1787864976.152172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864976.152175:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581a00, rc 0) 00000100:00100000:2.0:1787864976.152248:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071279872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 4777us (5404us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787864976.152257:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787864976.166589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.166785:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280128 00000100:00100000:0.0:1787864976.166794:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280128 00000100:00100000:0.0:1787864976.166851:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:0.0:1787864976.166861:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071280128:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787864976.166969:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.166998:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186191ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79bf expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167017:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa206f51c00) 00010000:00010000:0.0:1787864976.167027:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864976.167049:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167061:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167071:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167118:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167127:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167134:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167975:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167987:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.167994:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168000:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.168005:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168013:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168024:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864976.168027:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864976.168030:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168037:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186191ed6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168057:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168063:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168070:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168076:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.168079:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168085:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168093:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x10998215 (ffff9fa20378b800) 00010000:00010000:0.0:1787864976.168095:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864976.168098:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.168103:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186191edd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10998215 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.168197:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071280128:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1336us (1616us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864976.168206:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787864976.175834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.176547:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280256 00000100:00100000:3.0:1787864976.176563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280256 00000100:00100000:3.0:1787864976.176654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:3.0:1787864976.176680:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071280256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864976.176706:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864976.176733:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79c6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.176777:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.176793:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.176805:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.176918:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.177698:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.177709:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864976.177713:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864976.177718:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:1.0:1787864976.180732:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071280256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 4041us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864976.180749:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:2.0:1787864976.184384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864976.184575:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280512 00000100:00100000:1.0:1787864976.184606:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280512 00000100:00100000:1.0:1787864976.184701:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787864976.184714:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071280512:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787864976.184843:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.184868:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.184903:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787864976.185341:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787864976.185354:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292124956802ns, next at 293124953204ns, rc = 0 00000004:00010000:1.0:1787864976.185498:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aea8555c reply state 000000008faaa472 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864976.185508:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864976.187189:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10437:x1874712071280512:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 2468us (2815us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787864976.187203:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00010000:00010000:0.0:1787864976.191716:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191749:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191755:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191761:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.191766:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191774:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191789:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864976.191792:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787864976.191797:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.191803:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191ef2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864976.198204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.198288:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280640 00000100:00100000:2.0:1787864976.198302:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280640 00000100:00100000:2.0:1787864976.198364:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787864976.198385:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+16:10437:x1874712071280640:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864976.198424:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864976.198445:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79cd expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.198512:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.198527:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.198906:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864976.198909:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864976.198913:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581000, rc 0) 00000100:00100000:2.0:1787864976.198978:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10437:x1874712071280640:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 605us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.198986:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787864976.203248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.203336:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280768 00000100:00100000:3.0:1787864976.203348:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280768 00000100:00100000:3.0:1787864976.203433:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787864976.203442:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874712071280768:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787864976.203482:0:6694:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:3.0:1787864976.203543:0:6694:0:(genops.c:1385:class_connect()) connect: client 2ba0702c-0896-417b-a9c4-527e0244aed4, cookie 0xa63eebe186191f00 00002000:00100000:3.0:1787864976.203557:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ba0702c-0896-417b-a9c4-527e0244aed4/ffff9fa22ef94000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787864976.203586:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787864976.203881:0:6694:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787864976.203949:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9fa208000000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864976.204027:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2355:x1874712071280768:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 Request processed in 583us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.204036:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787864976.214576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864976.214704:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071280896 00000100:00100000:1.0:1787864976.214716:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071280896 00000100:00080000:2.0:1787864976.214782:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864976.214818:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:1.0:1787864976.214832:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:0:x1874712071280896:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1787864976.325184:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787864976.325204:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000100:00100000:1.0:1787864976.325254:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:0:x1874712071280896:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 110410us (110677us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787864976.325272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:1.0:1787864976.344132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.344282:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071281152 00000100:00100000:0.0:1787864976.344294:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071281152 00000100:00100000:0.0:1787864976.344373:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:0.0:1787864976.344420:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10437:x1874712071281152:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864976.344739:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10437:x1874712071281152:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 354us (629us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787864976.344747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787864976.349946:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.350077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071281408 00000100:00100000:2.0:1787864976.350089:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071281408 00000100:00100000:2.0:1787864976.350171:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787864976.350184:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10437:x1874712071281408:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787864976.350467:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10437:x1874712071281408:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 285us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.350476:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787864976.363447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.365053:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071281536 00000100:00100000:2.0:1787864976.365072:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071281536 00000100:00100000:2.0:1787864976.365168:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787864976.365181:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10437:x1874712071281536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864976.365208:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864976.365234:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186191f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365328:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365355:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365368:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864976.365439:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864976.365467:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365499:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186191f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79d4 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365517:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79d4 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.365527:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864976.365531:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864976.365536:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581400, rc 0) 00000100:00100000:2.0:1787864976.365642:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10437:x1874712071281536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 462us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.365651:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787864976.386659:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864976.386756:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864976.387434:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087031936 00000100:00100000:3.0:1787864976.387445:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087031936 00000100:00100000:3.0:1787864976.387536:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864976.387548:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087031936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864976.387578:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864976.387650:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087031936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.387657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787864976.388065:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864976.388125:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864976.390144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.390484:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071281664 00000100:00100000:3.0:1787864976.390495:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071281664 00000100:00100000:3.0:1787864976.390559:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787864976.390569:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071281664:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864976.390601:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864976.390627:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79db expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864976.390682:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a790, blocks: 0x1 00010000:00010000:3.0:1787864976.390704:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1787864976.390709:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864976.390719:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.390742:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.390757:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350800, rc 0) 00000100:00100000:3.0:1787864976.390819:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071281664:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 252us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.390827:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787864976.411267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.411581:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071281920 00000100:00100000:3.0:1787864976.411603:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071281920 00000100:00100000:3.0:1787864976.411686:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:3.0:1787864976.411699:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10437:x1874712071281920:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787864976.411836:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10437:x1874712071281920:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 140us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.411845:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787864976.420178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.420327:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282048 00000100:00100000:3.0:1787864976.420341:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282048 00000100:00100000:3.0:1787864976.420467:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787864976.420480:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:10437:x1874712071282048:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864976.420511:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864976.420536:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79e2 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.420578:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.420600:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864976.420606:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864976.420612:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.420654:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.420670:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 7 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.420686:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087032064:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864976.420803:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864976.427065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.427293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282176 00000100:00100000:0.0:1787864976.427311:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282176 00010000:00010000:0.0:1787864976.427363:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 8 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.427456:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787864976.427468:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071282176:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864976.427488:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.427521:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 8 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.427538:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 8 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.427573:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864976.427579:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864976.427599:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.427611:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.427660:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.427678:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1874712087032192:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787864976.427782:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b304600 going to sleep for 11 seconds 00010000:00010000:3.0:1787864976.428950:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221e25f4/0xa63eebe186191f15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79db expref: 8 pid: 6694 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.428972:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087032064:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864976.429012:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.429043:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350400, rc 0) 00000100:00100000:3.0:1787864976.429096:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:10437:x1874712071282048:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 8618us (8931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.429106:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:1.0:1787864976.442219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.443551:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282304 00000100:00100000:2.0:1787864976.443566:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282304 00002000:00100000:2.0:1787864976.443644:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa23babfc00 x1874712071282304/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:72/0 lens 504/0 e 0 to 0 dl 1787864987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864976.443657:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23babfc00 with x1874712071282304 ext(0->8) 00002000:00010000:2.0:1787864976.443663:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23babfc00 00000100:00100000:2.0:1787864976.443707:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787864976.443719:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071282304:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1787864976.446709:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864976.446800:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1874712087032192:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787864976.446833:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864976.446918:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071282176:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 19451us (19868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864976.446948:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787864976.450643:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2356:x1874712071282304:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 6910us (8422us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787864976.450663:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:0.0:1787864976.450679:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa23babfc00 x1874712071282304/t4294967302(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:72/0 lens 504/448 e 0 to 0 dl 1787864987 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864976.450691:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23babfc00 with x1874712071282304 ext(0->8) 00002000:00010000:0.0:1787864976.450698:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23babfc00 00000100:00100000:1.0:1787864976.474881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.475051:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282432 00000100:00100000:3.0:1787864976.475064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282432 00000100:00100000:3.0:1787864976.475153:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:3.0:1787864976.475165:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10437:x1874712071282432:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787864976.527248:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787864976.527278:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787864976.527299:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1787864976.527372:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071282432:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 52201us (52499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.527384:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000020:00080000:0.0:1787864976.527448:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787864976.527460:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787864976.527476:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087032320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787864976.527541:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864976.527625:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087032320 00000100:00100000:0.0:1787864976.527633:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087032320 00000100:00100000:0.0:1787864976.527690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864976.527701:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087032320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787864976.527895:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787864976.527899:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787864976 00002000:00010000:0.0:1787864976.527916:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787864976.527918:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787864976 -> 1787864976 00002000:00010000:0.0:1787864976.527921:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787864976.527966:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087032320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (424us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787864976.527974:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864976.529477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.529515:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282560 00000100:00100000:0.0:1787864976.529523:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282560 00000100:00100000:0.0:1787864976.529563:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:0.0:1787864976.529572:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071282560:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787864976.533610:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22ed0fc00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787864976.533629:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087032320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787864976.566225:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071282560:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 36638us (36740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864976.566242:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000001:00080000:0.0:1787864976.566286:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787864976.566298:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1787864976.568320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.568508:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282816 00000100:00100000:0.0:1787864976.568519:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282816 00000100:00100000:0.0:1787864976.568694:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:0.0:1787864976.568706:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071282816:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787864976.568777:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.568814:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186191f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79d4 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.568835:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864976.568841:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864976.568885:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.568909:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.568934:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864976.569271:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000469e807f reply state 00000000f40c30c3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.569281:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864976.569427:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10437:x1874712071282816:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 722us (1117us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787864976.569435:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00010000:00010000:1.0:1787864976.574538:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574561:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574569:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574575:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864976.574581:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574602:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574622:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:1.0:1787864976.574625:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864976.574631:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.574637:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186191f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864976.579221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.579328:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071282944 00000100:00100000:0.0:1787864976.579341:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071282944 00000100:00100000:0.0:1787864976.579442:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787864976.579454:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071282944:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787864976.579790:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787864976.579795:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787864976 -> 1787864976 00002000:00010000:0.0:1787864976.579798:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787864974 00002000:00010000:0.0:1787864976.579800:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787864976 -> 1787864976 00002000:00010000:0.0:1787864976.579802:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787864976.579873:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2359:x1874712071282944:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 421us (673us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787864976.579882:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787864976.582871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864976.582964:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283200 00000100:00100000:1.0:1787864976.582975:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283200 00000100:00100000:1.0:1787864976.583056:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:1.0:1787864976.583067:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10437:x1874712071283200:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787864976.583151:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.583171:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.583180:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.583253:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864976.583268:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 13 pid: 5850 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864976.583284:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f708f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087032448:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864976.583438:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51180 going to sleep for 11 seconds 00000100:00100000:2.0:1787864976.588083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.588154:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283328 00000100:00100000:3.0:1787864976.588164:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283328 00000100:00100000:0.0:1787864976.588181:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f708f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087032448:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864976.588216:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 14 pid: 5850 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.588263:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787864976.588275:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2359:x1874712071283328:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864976.588294:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.588294:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.588301:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 14 pid: 5850 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.588315:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 14 pid: 5850 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.588343:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79c6 expref: 14 pid: 5850 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.598666:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864976.598685:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.598702:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.598712:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.598770:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864976.598865:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2359:x1874712071283328:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 10586us (10790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.598876:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00010000:00010000:0.0:1787864976.598885:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598893:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598935:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598943:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598951:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598957:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864976.598962:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598971:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598984:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864976.598987:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787864976.598991:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.598998:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186191f2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.599047:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10437:x1874712071283200:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 15982us (16187us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787864976.599066:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787864976.601805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.603977:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283456 00000100:00100000:0.0:1787864976.603994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283456 00000100:00100000:0.0:1787864976.604078:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787864976.604089:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071283456:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787864976.604156:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.604181:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.604190:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864976.604196:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864976.604201:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.604245:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.604263:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 7 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.604279:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087032576:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864976.604390:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864976.607207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.607278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283584 00000100:00100000:0.0:1787864976.607287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283584 00000100:00100000:3.0:1787864976.607305:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087032576:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864976.607332:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607338:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.607372:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787864976.607393:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071283584:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864976.607446:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.607475:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.607491:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.607520:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7684d15/0xa63eebe186191f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e2 expref: 8 pid: 6695 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.607542:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864976.607546:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864976.607553:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.607564:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.607603:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864976.607624:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607632:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.607659:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071283584:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 277us (466us total) trans 0 rc 0/0 00010000:00010000:3.0:1787864976.607660:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.607673:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00010000:00010000:3.0:1787864976.607674:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607682:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607689:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864976.607694:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607703:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607715:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.607723:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069283751/0xa63eebe186191f31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.607792:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071283456:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 3705us (5997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864976.607801:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:3.0:1787864976.612317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.613281:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283840 00000100:00100000:2.0:1787864976.613295:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283840 00000100:00100000:2.0:1787864976.613645:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787864976.613661:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+12:10437:x1874712071283840:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787864976.613763:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.613785:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.613798:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.614193:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.614224:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 13 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.614234:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.614287:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 13 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.614304:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 13 pid: 8208 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864976.614320:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087032704:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864976.614825:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864976.619426:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087032704:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864976.619471:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.622887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864976.623876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071283968 00000100:00100000:2.0:1787864976.623891:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071283968 00010000:00010000:2.0:1787864976.623956:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 14 pid: 8208 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864976.624004:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787864976.624015:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071283968:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864976.624034:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864976.624054:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 14 pid: 8208 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624070:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 14 pid: 8208 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624100:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe186191ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79cd expref: 14 pid: 8208 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624129:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864976.624136:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624146:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624155:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864976.624193:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864976.624392:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2358:x1874712071283968:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 367us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.624421:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00010000:00010000:3.0:1787864976.626476:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.626514:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864976.626797:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787864976.627263:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787864976.627322:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787864976.627451:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc303c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087032832:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864976.627549:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864976.627601:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864976.627728:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087032832 00000100:00100000:2.0:1787864976.627737:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087032832 00000100:00100000:2.0:1787864976.627792:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864976.627803:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087032832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864976.627814:0:5855:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787864976.627821:0:5855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787864976.627893:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087032832:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864976.627911:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864976.628217:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787864976.628224:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa22ed0fc00, transno 4294967303 00000100:00100000:3.0:1787864976.628247:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc303c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087032832:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787864976.630235:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787864976.630341:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc303c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087032960:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864976.630440:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864976.630475:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864976.630505:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087032960 00000100:00100000:2.0:1787864976.630515:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087032960 00000100:00100000:2.0:1787864976.630562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864976.630572:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087032960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787864976.630851:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874712087032960:12345-0@lo:1000:mdt00_001.0 Request processed in 278us (408us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787864976.630860:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864976.630987:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc303c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087032960:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787864976.631134:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631145:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631153:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631171:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864976.631176:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631185:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631206:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864976.631209:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864976.631216:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631222:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186191f3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631264:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631271:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631278:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631283:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864976.631286:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631291:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631310:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:3.0:1787864976.631313:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864976.631316:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631322:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186191e74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631346:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631362:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631371:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631421:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.631437:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 16 pid: 5849 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.631451:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc30f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087033088:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864976.635087:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864976.635497:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864976.635527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071284096 00000100:00100000:3.0:1787864976.635534:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc30f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087033088:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864976.635534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071284096 00010000:00010000:3.0:1787864976.635568:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635575:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 17 pid: 5849 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864976.635623:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787864976.635634:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:2358:x1874712071284096:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864976.635653:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864976.635660:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 17 pid: 5849 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635674:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 17 pid: 5849 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635701:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186191e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79b1 expref: 17 pid: 5849 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635716:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:0.0:1787864976.635721:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635733:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635741:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.635779:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864976.635841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+16:2358:x1874712071284096:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 208us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864976.635850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00010000:00010000:3.0:1787864976.638022:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638041:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638058:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638066:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638073:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638080:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864976.638085:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638094:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638113:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:3.0:1787864976.638118:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864976.638125:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638133:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638145:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638168:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638174:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638180:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864976.638184:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638191:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638200:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa211170e00) 00010000:00010000:3.0:1787864976.638203:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864976.638206:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.638212:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186191f38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864976.638555:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071283840:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 24892us (26246us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787864976.638567:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000020:00080000:3.0:1787864976.638574:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787864976.638635:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864976.638642:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864976.638671:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787864976.638678:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864976.640770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864976.640849:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071284352 00000100:00100000:3.0:1787864976.640870:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071284352 00000100:00100000:3.0:1787864976.640947:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787864976.640960:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10437:x1874712071284352:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787864976.641817:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787864976.641940:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787864976.641992:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642012:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642027:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642037:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642044:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642052:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864976.642078:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864976.642204:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10437:x1874712071284352:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1243us (1444us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787864976.642215:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000020:00080000:3.0:1787864976.642222:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787864976.642299:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864976.642308:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.642315:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787864976.642320:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.642330:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.642345:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa20c8dcf00) 00010000:00010000:0.0:1787864976.642349:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787864976.642354:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.642360:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186191f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864976.642378:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864976.642379:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864976.642393:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787864977.080083:0:11999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864977.080094:0:11999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864977.080148:0:11999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787864977.080161:0:11999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864977.224135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.224239:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071284608 00000100:00100000:3.0:1787864977.224252:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071284608 00000100:00100000:3.0:1787864977.224346:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787864977.224362:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+17:10453:x1874712071284608:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864977.224426:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.224470:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79e9 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.224815:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191f5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.224831:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191f5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.224846:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191f5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864977.224859:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787864977.225060:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e9 expref: 20 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.225079:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191f5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e9 expref: 19 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.225089:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.225092:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864977.225096:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350800, rc 0) 00000100:00100000:3.0:1787864977.225170:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10453:x1874712071284608:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 815us (1050us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787864977.225178:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00080000:0.0:1787864977.225328:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864977.228773:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.231507:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071284736 00000100:00100000:3.0:1787864977.231522:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071284736 00000100:00100000:3.0:1787864977.231614:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787864977.231627:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10453:x1874712071284736:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787864977.231734:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.231755:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.231769:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.231786:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.231793:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.231799:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232148:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232157:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232164:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864977.232225:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232242:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232260:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232267:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232274:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.232278:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232287:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232301:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.232305:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.232310:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232317:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232330:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232336:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232342:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232347:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.232356:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232361:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232369:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.232371:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.232374:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232379:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232394:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232426:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232432:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232437:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.232441:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232446:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232453:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dc400) 00010000:00010000:3.0:1787864977.232456:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.232464:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.232470:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.232572:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10453:x1874712071284736:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 946us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.232582:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787864977.278393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.278577:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071284992 00000100:00100000:3.0:1787864977.278599:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071284992 00000100:00100000:3.0:1787864977.278681:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:3.0:1787864977.278696:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10456:x1874712071284992:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864977.278721:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.278749:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278841:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278858:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278870:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278886:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278894:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.278916:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.279337:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.279347:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.279355:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864977.279366:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787864977.281528:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281546:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281555:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281564:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.281568:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281577:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281608:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.281612:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.281632:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281639:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281657:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281664:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281670:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281676:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.281678:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281684:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281693:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dc400) 00010000:00010000:3.0:1787864977.281695:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.281698:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281704:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281774:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281804:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.281812:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.281814:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864977.281817:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864977.282027:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10456:x1874712071284992:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3334us (3648us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787864977.282037:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787864977.289431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864977.289523:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071285120 00000100:00100000:1.0:1787864977.289536:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071285120 00000100:00100000:1.0:1787864977.289614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:1.0:1787864977.289627:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10456:x1874712071285120:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787864977.289711:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289744:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289759:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289794:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289801:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289808:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289814:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864977.289819:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289828:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289841:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:1.0:1787864977.289845:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864977.289851:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864977.289858:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186191fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864977.289962:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10456:x1874712071285120:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 337us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864977.289976:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787864977.298183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.298269:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071285376 00000100:00100000:2.0:1787864977.298281:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071285376 00000100:00100000:2.0:1787864977.298353:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:2.0:1787864977.298366:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10456:x1874712071285376:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864977.298706:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:10456:x1874712071285376:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 343us (536us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787864977.298716:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:2.0:1787864977.351639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.353376:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071285632 00000100:00100000:3.0:1787864977.353393:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071285632 00000100:00100000:3.0:1787864977.353490:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:3.0:1787864977.353503:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+22:9985:x1874712071285632:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864977.353550:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.353577:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191fa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79f7 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.353705:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.353722:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.353731:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.353770:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.353795:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 23 pid: 5850 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.353813:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087033216:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864977.353938:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f52ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864977.376099:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087033216:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864977.376146:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.376334:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.376429:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071285760 00000100:00100000:3.0:1787864977.376447:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071285760 00010000:00010000:3.0:1787864977.376495:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 24 pid: 5850 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.376529:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787864977.376539:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+24:2357:x1874712071285760:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864977.376557:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864977.376565:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 24 pid: 5850 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376579:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 24 pid: 5850 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376616:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f0 expref: 24 pid: 5850 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376655:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.376661:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376671:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376680:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.376707:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864977.376774:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+23:2357:x1874712071285760:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 236us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.376782:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00010000:00010000:0.0:1787864977.377163:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.377172:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864977.377194:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787864977.377389:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191fa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 24 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.377431:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 23 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.377529:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864977.377532:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787864977.377534:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:0.0:1787864977.377573:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+23:9985:x1874712071285632:12345-192.168.206.10@tcp:101:bash.0 Request processed in 24073us (26178us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787864977.377580:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:2.0:1787864977.380863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.380954:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286016 00000100:00100000:3.0:1787864977.380967:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286016 00000100:00100000:3.0:1787864977.381041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:3.0:1787864977.381053:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+23:9985:x1874712071286016:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:3.0:1787864977.381376:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.381432:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.381446:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864977.381508:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787864977.381842:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000231c8b85 reply state 00000000ad21ab01 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.381875:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787864977.381931:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787864977.382178:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+27:9985:x1874712071286016:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1125us (1324us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787864977.382187:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000020:00080000:3.0:1787864977.382193:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787864977.384226:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384263:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384272:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384278:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.384283:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384291:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384309:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864977.384313:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864977.384318:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.384324:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.390160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.390383:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286144 00000100:00100000:3.0:1787864977.390423:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286144 00000100:00100000:3.0:1787864977.390493:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:3.0:1787864977.390505:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+26:9985:x1874712071286144:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864977.390536:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.390562:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f79fe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.390650:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79fe expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.390667:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79fe expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.390689:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.390692:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864977.390697:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864977.390771:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+27:9985:x1874712071286144:12345-192.168.206.10@tcp:101:bash.0 Request processed in 268us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.390780:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:2.0:1787864977.397480:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.397593:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286272 00000100:00100000:3.0:1787864977.397605:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286272 00000100:00100000:3.0:1787864977.397671:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787864977.397683:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:9985:x1874712071286272:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864977.397709:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.397745:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a05 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864977.397780:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90a790, atime: 0x6a90a78e, ctime: 0x6a90a790, blocks: 0xb 00010000:00010000:3.0:1787864977.397810:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1787864977.397816:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864977.397826:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.397848:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.397863:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864977.397934:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:9985:x1874712071286272:12345-192.168.206.10@tcp:101:bash.0 Request processed in 253us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.397941:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:1.0:1787864977.405740:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.405923:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286400 00000100:00100000:0.0:1787864977.405936:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286400 00002000:00010000:0.0:1787864977.405991:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787864977.405998:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f70a1c0 with x1874712071286400 ext(0->18446744073709551615) 00002000:00010000:0.0:1787864977.406014:0:6700:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f70a1c0. 00000100:00100000:0.0:1787864977.406055:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787864977.406067:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071286400:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:0.0:1787864977.406456:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787864977.406474:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787864976 -> 1787864977 00002000:00010000:0.0:1787864977.406477:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787864974 -> 1787864974 00002000:00010000:0.0:1787864977.406480:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787864976 -> 1787864977 00002000:00010000:0.0:1787864977.406482:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787864977.406541:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071286400:12345-192.168.206.10@tcp:10:bash.0 Request processed in 476us (815us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787864977.406551:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00010000:0.0:1787864977.406556:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787864977.406559:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f70a1c0 with x1874712071286400 ext(0->18446744073709551615) 00002000:00010000:0.0:1787864977.406564:0:6700:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f70a1c0. 00010000:00010000:1.0:1787864977.467725:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864977.474314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.474623:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286528 00000100:00100000:0.0:1787864977.474635:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286528 00000100:00100000:0.0:1787864977.474746:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:0.0:1787864977.474758:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+27:10470:x1874712071286528:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787864977.474853:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.474873:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.474888:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.474905:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.474913:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.474932:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475291:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475302:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475310:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864977.475358:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475372:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475685:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475694:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475701:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.475706:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475714:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475729:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864977.475733:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864977.475738:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475753:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186191fd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475769:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475775:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475781:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475786:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.475790:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475797:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475804:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20378bf00) 00010000:00010000:0.0:1787864977.475807:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864977.475810:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475815:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186191fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475831:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475838:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475849:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475854:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.475857:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475864:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475872:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864977.475875:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864977.475878:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.475883:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186191fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.476753:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+27:10470:x1874712071286528:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1989us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864977.476764:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:2.0:1787864977.513272:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.513692:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286784 00000100:00100000:3.0:1787864977.513705:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286784 00000100:00100000:3.0:1787864977.513788:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:3.0:1787864977.513801:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+27:10473:x1874712071286784:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864977.513825:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.513869:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a0c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.513971:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.513989:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514003:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514020:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514028:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514034:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514657:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514669:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514677:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864977.514688:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787864977.514798:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514816:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514822:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514828:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.514834:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514842:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514856:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.514860:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.514865:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514872:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186191fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514891:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514899:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514906:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514911:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.514921:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514928:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514948:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dcb00) 00010000:00010000:3.0:1787864977.514951:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.514955:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.514961:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186191ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.515012:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186191fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a0c expref: 30 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.515026:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a0c expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.515033:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.515036:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787864977.515038:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350000, rc 0) 00000100:00100000:3.0:1787864977.515118:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10473:x1874712071286784:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1320us (1859us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787864977.515126:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787864977.518731:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.518859:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071286912 00000100:00100000:2.0:1787864977.518871:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071286912 00000100:00100000:2.0:1787864977.518972:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:2.0:1787864977.518984:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10473:x1874712071286912:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787864977.519069:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.519088:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 29 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.519098:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.519141:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 29 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.519157:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 29 pid: 8208 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.519173:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087033344:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864977.519293:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864977.523285:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.523369:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071287168 00000100:00100000:3.0:1787864977.523390:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071287168 00000100:00100000:3.0:1787864977.523502:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787864977.523514:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+30:5592:x1874712071287168:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787864977.523948:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+31:5592:x1874712071287168:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 436us (677us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787864977.523956:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787864977.524532:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087033344:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864977.524570:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.526635:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.526732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071287296 00000100:00100000:3.0:1787864977.526742:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071287296 00010000:00010000:3.0:1787864977.526792:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 31 pid: 8208 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.526834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787864977.526845:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+31:2359:x1874712071287296:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864977.526863:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864977.526871:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 31 pid: 8208 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.526885:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 31 pid: 8208 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.526912:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186191faf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79f7 expref: 31 pid: 8208 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.527059:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.527065:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.527077:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.527086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.527211:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864977.527286:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+30:2359:x1874712071287296:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 442us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.527295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00010000:00010000:2.0:1787864977.528841:0:10329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.528857:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.528895:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.528903:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.529055:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.529062:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864977.529067:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.529077:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.529094:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864977.529097:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864977.529102:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.529109:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619200a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.529276:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10473:x1874712071286912:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 10292us (10556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864977.529288:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:0.0:1787864977.533834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.534080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071287552 00000100:00100000:3.0:1787864977.534093:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071287552 00000100:00100000:3.0:1787864977.534368:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787864977.534393:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+29:10473:x1874712071287552:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864977.534726:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10473:x1874712071287552:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 347us (905us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787864977.534735:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787864977.606747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.606876:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071287808 00000100:00100000:2.0:1787864977.606889:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071287808 00000100:00100000:2.0:1787864977.606976:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:2.0:1787864977.606988:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+30:10484:x1874712071287808:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:2.0:1787864977.607023:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864977.607048:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a13 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607164:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607182:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607196:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607225:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607234:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607241:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607689:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607699:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607707:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864977.607719:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787864977.607833:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607842:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607856:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607863:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864977.607869:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607877:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607891:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:2.0:1787864977.607895:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864977.607901:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607907:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607920:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607926:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607931:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607937:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864977.607940:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607956:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607964:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa206f51500) 00010000:00010000:2.0:1787864977.607967:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864977.607970:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.607975:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe18619201f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.608024:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a13 expref: 33 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.608039:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a13 expref: 32 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.608045:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864977.608048:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864977.608050:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581c00, rc 0) 00000100:00100000:2.0:1787864977.608128:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+32:10484:x1874712071287808:12345-192.168.206.10@tcp:101:cat.0 Request processed in 1142us (1394us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787864977.608136:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:1.0:1787864977.612609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.612787:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288064 00000100:00100000:2.0:1787864977.612801:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288064 00000100:00100000:2.0:1787864977.612879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:2.0:1787864977.612891:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+32:10484:x1874712071288064:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:2.0:1787864977.613719:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10484:x1874712071288064:12345-192.168.206.10@tcp:35:cat.0 Request processed in 825us (1129us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787864977.613728:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:1.0:1787864977.632317:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.632523:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288320 00000100:00100000:3.0:1787864977.632535:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288320 00000100:00100000:3.0:1787864977.632622:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:3.0:1787864977.632634:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10485:x1874712071288320:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787864977.632716:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787864977.632750:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a13 expref: 33 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632774:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186191ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a0c expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632787:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186191fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79fe expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632797:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.632828:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864977.632854:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632868:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632879:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632893:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632899:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.632905:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.633299:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.633308:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.633315:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864977.634197:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787864977.634209:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293573811763ns, next at 294573808372ns, rc = 0 00010000:00010000:3.0:1787864977.634901:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635075:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635086:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635095:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635103:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635108:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635169:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864977.635197:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635204:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635210:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635226:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.635231:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635239:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635263:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dcd00) 00010000:00010000:3.0:1787864977.635266:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787864977.635272:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635278:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192042 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635298:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635304:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635309:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635314:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.635316:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635322:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635328:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.635330:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.635333:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.635338:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192034 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864977.635360:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e60c2fb reply state 000000006d9c2522 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.635369:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864977.635699:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+32:10485:x1874712071288320:12345-192.168.206.10@tcp:36:rm.0 Request processed in 3063us (3391us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787864977.635708:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00010000:00010000:2.0:1787864977.641625:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641648:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641656:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641663:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864977.641669:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641677:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641696:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dcb00) 00010000:00010000:2.0:1787864977.641699:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864977.641705:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.641712:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619203b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.646965:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864977.646994:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.647009:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787864977.647013:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.647050:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.647074:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa20c8dcd00) 00010000:00010000:0.0:1787864977.647077:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787864977.647082:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.647090:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192049 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.647122:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864977.647124:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864977.647127:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864977.680681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.681550:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288576 00000100:00100000:2.0:1787864977.681564:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288576 00000100:00100000:2.0:1787864977.681723:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:2.0:1787864977.681736:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+31:10491:x1874712071288576:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787864977.681790:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864977.681815:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192050 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a1a expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.681983:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.682069:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.682083:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.682099:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.682107:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.682114:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864977.683101:0:10329:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787864977.683605:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683804:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683817:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683881:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683889:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683896:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683902:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864977.683907:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683916:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683930:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:2.0:1787864977.683934:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864977.683939:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.683946:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192057 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864977.683961:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad9adb67 reply state 00000000c67675ce transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.683971:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787864977.684019:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192050 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 34 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.684048:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 33 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.684056:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:2.0:1787864977.684059:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864977.684061:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580600, rc 0) 00000100:00100000:2.0:1787864977.684163:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+34:10491:x1874712071288576:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2428us (3493us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787864977.684172:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:1.0:1787864977.689656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787864977.689751:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689766:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689775:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689782:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.689788:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689798:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689820:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa206f51500) 00010000:00010000:0.0:1787864977.689842:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864977.689850:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.689858:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619205e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.690139:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288704 00000100:00100000:3.0:1787864977.690151:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288704 00000100:00100000:3.0:1787864977.690246:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787864977.690264:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071288704:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864977.690287:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.690309:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a21 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864977.690340:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787864977.690367:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=293s v=(0 0) 00010000:00010000:3.0:1787864977.690372:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864977.690383:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.690441:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.690456:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787864977.690531:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071288704:12345-192.168.206.10@tcp:101:bash.0 Request processed in 274us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.690548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00080000:0.0:1787864977.693021:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864977.693637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.693739:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288832 00000100:00100000:0.0:1787864977.693750:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288832 00000100:00100000:0.0:1787864977.693818:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787864977.693829:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:10491:x1874712071288832:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864977.693851:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864977.693872:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a28 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.693911:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.693934:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864977.693940:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864977.693946:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.693987:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.694002:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 9 pid: 6696 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.694036:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874712087033472:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864977.694154:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864977.697250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.697476:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071288960 00000100:00100000:3.0:1787864977.697487:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071288960 00010000:00010000:3.0:1787864977.697541:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 10 pid: 6696 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.697593:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787864977.697605:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071288960:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864977.697623:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864977.697652:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 10 pid: 6696 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.697668:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 10 pid: 6696 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.697699:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864977.697703:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864977.697714:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.697727:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.697769:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.697810:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874712087033600:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787864977.697905:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f52c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864977.699990:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1874712087033600:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787864977.700023:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864977.700086:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071288960:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2483us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.700098:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00010000:00010000:0.0:1787864977.701444:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a21 expref: 9 pid: 6696 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.701468:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874712087033472:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864977.701501:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.701518:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493000, rc 0) 00000100:00100000:0.0:1787864977.701578:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f708b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:10491:x1874712071288832:12345-192.168.206.10@tcp:101:bash.0 Request processed in 7750us (7948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864977.701596:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787864977.704693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.704780:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071289216 00000100:00100000:0.0:1787864977.704791:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071289216 00000100:00100000:0.0:1787864977.704857:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787864977.704868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+33:10491:x1874712071289216:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:0.0:1787864977.705347:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+34:10491:x1874712071289216:12345-192.168.206.10@tcp:35:bash.0 Request processed in 480us (666us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787864977.705356:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:1.0:1787864977.828884:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.829010:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071289344 00000100:00100000:0.0:1787864977.829024:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071289344 00000100:00100000:0.0:1787864977.829102:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:0.0:1787864977.829131:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+34:10507:x1874712071289344:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864977.829166:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864977.829192:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a2f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829286:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829302:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829314:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864977.829440:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787864977.829445:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864977.829473:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829505:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a2f expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829524:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a2f expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.829533:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864977.829536:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864977.829540:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493c00, rc 0) 00000100:00100000:0.0:1787864977.829625:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:10507:x1874712071289344:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 496us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864977.829641:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:1.0:1787864977.834312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.834741:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071289600 00000100:00100000:3.0:1787864977.834755:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071289600 00000100:00100000:3.0:1787864977.834835:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:3.0:1787864977.834848:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+35:10507:x1874712071289600:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864977.834874:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864977.834900:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619208f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a36 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.835037:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.835054:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.835067:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864977.835079:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787864977.835246:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619208f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a36 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.835286:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a36 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.835296:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:3.0:1787864977.835299:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864977.835303:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864977.835372:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+37:10507:x1874712071289600:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 528us (1073us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787864977.835380:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:2.0:1787864977.841847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.841955:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071289856 00000100:00100000:0.0:1787864977.841968:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071289856 00000100:00100000:0.0:1787864977.842044:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:0.0:1787864977.842057:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+37:10507:x1874712071289856:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864977.842089:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864977.842114:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a3d expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.842244:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.842261:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.842275:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864977.842290:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787864977.842492:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a3d expref: 40 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.842513:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a3d expref: 39 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.842535:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787864977.842539:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864977.842544:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492600, rc 0) 00000100:00100000:0.0:1787864977.842642:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+39:10507:x1874712071289856:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 586us (810us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787864977.842650:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:1.0:1787864977.849543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.849649:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071289984 00000100:00100000:3.0:1787864977.849661:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071289984 00000100:00100000:3.0:1787864977.849734:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787864977.849747:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2356:x1874712071289984:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:3.0:1787864977.849809:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.849834:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.849843:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864977.849848:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864977.849854:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.849897:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.849944:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 8 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.849962:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087033728:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864977.850094:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f52c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864977.853373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.854177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290112 00000100:00100000:3.0:1787864977.854189:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290112 00000100:00100000:3.0:1787864977.854287:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787864977.854299:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+39:2356:x1874712071290112:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864977.854320:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864977.854353:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a36 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.854375:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:3.0:1787864977.854388:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864977.854506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+38:2356:x1874712071290112:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 208us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.854514:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787864977.855030:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc321c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087033728:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864977.855062:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864977.856240:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.856334:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290240 00000100:00100000:0.0:1787864977.856344:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290240 00002000:00100000:0.0:1787864977.856442:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa22f70b0c0 x1874712071290240/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:73/0 lens 504/0 e 0 to 0 dl 1787864988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864977.856453:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f70b0c0 with x1874712071290240 ext(0->8) 00010000:00010000:0.0:1787864977.856462:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 9 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.856479:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 9 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864977.856487:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa22f70b0c0 00000100:00100000:0.0:1787864977.856514:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787864977.856525:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2358:x1874712071290240:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:0.0:1787864977.857537:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+11:2358:x1874712071290240:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 1006us (1297us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787864977.857547:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00100000:0.0:1787864977.857557:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa22f70b0c0 x1874712071290240/t4294967302(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:73/0 lens 504/448 e 0 to 0 dl 1787864988 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864977.857567:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f70b0c0 with x1874712071290240 ext(0->8) 00010000:00010000:0.0:1787864977.857574:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.857613:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864977.857620:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa22f70b0c0 00000100:00100000:1.0:1787864977.861662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.861776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290368 00000100:00100000:2.0:1787864977.861789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290368 00010000:00010000:2.0:1787864977.861841:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.861888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:2.0:1787864977.861898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+11:2359:x1874712071290368:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864977.862070:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787864977.862096:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787864977.862099:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787864978 00002000:00010000:2.0:1787864977.862102:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787864978 00002000:00010000:2.0:1787864977.862104:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787864978 00010000:00010000:2.0:1787864977.862112:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.862143:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.862172:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e337666d/0xa63eebe18619207a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a28 expref: 11 pid: 6694 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.862191:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864977.862196:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864977.862204:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.862214:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.862256:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864977.862429:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862450:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862479:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862488:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862495:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862503:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864977.862507:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862516:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862529:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.862537:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe1861920b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864977.862779:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2359:x1874712071290368:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 879us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864977.862790:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787864977.863676:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2356:x1874712071289984:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 13929us (14144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.863687:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787864977.866806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864977.866905:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290624 00000100:00100000:0.0:1787864977.867051:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290624 00000100:00100000:0.0:1787864977.867163:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787864977.867176:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+38:10507:x1874712071290624:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:0.0:1787864977.867274:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a3d expref: 38 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864977.867639:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787864977.867689:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787864977.868656:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787864977.868735:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.868756:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 42 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.868768:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.868809:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 42 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.868826:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 42 pid: 10329 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.868862:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087033856:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864977.869109:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d65540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864977.872763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.872954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290752 00000100:00100000:3.0:1787864977.872965:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290752 00010000:00010000:3.0:1787864977.873027:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 43 pid: 10329 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.873077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:3.0:1787864977.873089:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+43:2358:x1874712071290752:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864977.873110:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864977.873118:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 43 pid: 10329 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.873132:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 43 pid: 10329 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.873160:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:3.0:1787864977.873167:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.873177:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.873185:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.873241:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864977.873315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+43:2358:x1874712071290752:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 226us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.873323:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00010000:00010000:0.0:1787864977.875592:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a1a expref: 42 pid: 10329 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.875623:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087033856:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864977.875652:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.875663:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.875667:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864977.875830:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787864977.876815:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787864977.877596:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087033984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864977.877683:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864977.877724:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2048a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864977.877890:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087033984 00000100:00100000:2.0:1787864977.877899:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087033984 00000100:00100000:2.0:1787864977.877997:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787864977.878008:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1874712087033984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864977.878098:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1874712087033984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864977.878118:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787864977.878304:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864977.878339:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087033984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787864977.879107:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787864977.879191:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087034112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864977.879237:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864977.879270:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864977.879516:0:11973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087034112 00000100:00100000:2.0:1787864977.879523:0:11973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087034112 00000100:00100000:2.0:1787864977.879567:0:11973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864977.879577:0:11973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5852:x1874712087034112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864977.879775:0:11973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5852:x1874712087034112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (535us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787864977.879782:0:11973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864977.879907:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea34b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087034112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787864977.880088:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787864977.880137:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880148:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880156:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880168:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864977.880173:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880181:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880201:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787864977.880204:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787864977.880209:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864977.880216:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe1861920c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864977.881110:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787864977.881247:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787864977.881261:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293820863881ns, next at 294820859605ns, rc = 0 00000001:00080000:0.0:1787864977.881270:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787864977.881343:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787864977.881348:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864977.881359:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861920ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a3d expref: 46 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864977.881542:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+45:10507:x1874712071290624:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 14368us (14748us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787864977.881553:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000020:00080000:0.0:1787864977.881560:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787864977.884602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864977.884712:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071290880 00000100:00100000:2.0:1787864977.884725:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071290880 00000100:00100000:2.0:1787864977.884797:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:2.0:1787864977.884809:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f708780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+45:10507:x1874712071290880:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787864977.884840:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864977.884870:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe1861920c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a44 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.884955:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe1861920c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a44 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.884973:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe1861920c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a44 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864977.884994:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864977.884998:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864977.885003:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581a00, rc 0) 00000100:00100000:2.0:1787864977.885119:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f708780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+46:10507:x1874712071290880:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 311us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864977.885144:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:2.0:1787864977.888903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.889021:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071291136 00000100:00100000:3.0:1787864977.889033:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071291136 00000100:00100000:3.0:1787864977.889106:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787864977.889117:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+46:10507:x1874712071291136:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864977.889478:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10507:x1874712071291136:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 362us (588us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787864977.889486:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787864977.953952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864977.954109:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071291264 00000100:00100000:3.0:1787864977.954122:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071291264 00000100:00100000:3.0:1787864977.954198:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:3.0:1787864977.954211:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10517:x1874712071291264:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787864977.954323:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954344:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954356:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954372:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954379:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954446:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954565:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954574:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954592:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864977.954645:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954660:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954667:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954674:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954680:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.954685:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954692:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954705:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864977.954715:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.954722:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954729:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954746:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954754:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954760:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954766:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.954768:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954774:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954781:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864977.954784:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.954786:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954791:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954805:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954819:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954825:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954831:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864977.954834:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954841:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954850:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864977.954852:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864977.954855:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864977.954861:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864977.955115:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10517:x1874712071291264:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 905us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864977.955125:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:1.0:1787864978.000680:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.000742:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071291520 00000100:00100000:3.0:1787864978.000756:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071291520 00000100:00100000:3.0:1787864978.000834:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:3.0:1787864978.000846:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+47:10520:x1874712071291520:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864978.000881:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.001119:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a4b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001234:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001253:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001267:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001283:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001291:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001297:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001916:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861920f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001928:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861920f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.001944:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861920f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864978.001956:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787864978.007370:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007437:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007445:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007452:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.007457:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007467:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007486:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864978.007490:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.007496:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007501:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861920ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007519:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007525:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007531:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007537:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.007546:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007553:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007562:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864978.007565:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.007568:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007574:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861920f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007653:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861920e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a4b expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007670:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861920f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a4b expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.007677:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.007679:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864978.007682:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864978.007772:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10520:x1874712071291520:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 6928us (7106us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787864978.007782:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:2.0:1787864978.018633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.018801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071291648 00000100:00100000:3.0:1787864978.018815:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071291648 00000100:00100000:3.0:1787864978.018908:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:3.0:1787864978.018921:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10520:x1874712071291648:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:3.0:1787864978.019048:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019068:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019081:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019113:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019121:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019128:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019134:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.019139:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019148:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019162:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.019166:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864978.019172:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.019178:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864978.019282:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10520:x1874712071291648:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 364us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.019291:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:0.0:1787864978.024927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.025180:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071291904 00000100:00100000:3.0:1787864978.025191:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071291904 00000100:00100000:3.0:1787864978.025263:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787864978.025275:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+49:10520:x1874712071291904:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864978.025677:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:10520:x1874712071291904:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 403us (763us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787864978.025686:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:1.0:1787864978.134840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.134962:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071292160 00000100:00100000:0.0:1787864978.134975:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071292160 00000100:00100000:0.0:1787864978.135062:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:0.0:1787864978.135074:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f708f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+50:10530:x1874712071292160:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864978.135104:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864978.135108:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864978.135153:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a2f expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135177:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864978.135183:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864978.135201:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe18619210d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a52 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135328:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135345:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135386:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864978.135466:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787864978.135637:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe18619210d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 52 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135652:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.135659:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787864978.135662:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864978.135664:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493e00, rc 0) 00000100:00100000:0.0:1787864978.135742:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f708f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10530:x1874712071292160:12345-192.168.206.10@tcp:101:bash.0 Request processed in 671us (917us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787864978.135750:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:2.0:1787864978.140725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.140776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.140851:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071292544 00000100:00100000:0.0:1787864978.140864:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071292544 00000100:00100000:0.0:1787864978.140938:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:0.0:1787864978.140950:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10530:x1874712071292544:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787864978.141033:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864978.141066:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861920f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a4b expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.141085:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787864978.141092:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864978.141370:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.141385:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.141429:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.141467:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.141482:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864978.141500:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210159680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087034240:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864978.141612:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d65180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864978.143336:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071292288 00000100:00100000:3.0:1787864978.143350:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071292288 00010000:00010000:3.0:1787864978.143969:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 52 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864978.144036:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787864978.144051:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+52:2359:x1874712071292288:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864978.144070:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864978.144077:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 52 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.144092:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 52 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.144824:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.144847:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.144859:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.144867:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.144893:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864978.144983:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+52:2359:x1874712071292288:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 935us (4270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.146623:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:0.0:1787864978.146940:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.10@tcp) returned -22 from blocking AST (req@0000000087e99a52 x1874712087034240) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.146963:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe186192114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a52 expref: 51 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864978.146981:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210159680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087034240:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864978.147007:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787864978.147016:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.147046:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.147053:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864978.147221:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787864978.147283:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073259126 reply state 00000000ec31dd6a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864978.147292:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864978.147599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:10530:x1874712071292544:12345-192.168.206.10@tcp:36:bash.0 Request processed in 6650us (6820us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787864978.147607:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000020:00080000:0.0:1787864978.147611:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787864978.154878:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154901:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154910:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154927:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864978.154936:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154946:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154969:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864978.154972:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864978.154979:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.154986:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192122 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.156032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.160614:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071292672 00000100:00100000:3.0:1787864978.160635:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071292672 00000100:00100000:3.0:1787864978.160775:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787864978.160788:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+51:10530:x1874712071292672:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864978.160821:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.160847:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a59 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.160988:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.161006:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.161019:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864978.161051:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787864978.161075:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864978.161100:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.161145:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.161165:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.161174:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.161178:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864978.161182:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864978.161309:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+52:10530:x1874712071292672:12345-192.168.206.10@tcp:101:bash.0 Request processed in 524us (5285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.161317:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:0.0:1787864978.169672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.169737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071292928 00000100:00100000:2.0:1787864978.169763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071292928 00000100:00100000:2.0:1787864978.169835:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787864978.169847:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:10530:x1874712071292928:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787864978.170179:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+53:10530:x1874712071292928:12345-192.168.206.10@tcp:35:bash.0 Request processed in 333us (523us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787864978.170188:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787864978.254737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.255503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293056 00000100:00100000:1.0:1787864978.255517:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293056 00000100:00100000:1.0:1787864978.255605:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:1.0:1787864978.255619:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+53:10536:x1874712071293056:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864978.255648:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864978.255674:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a60 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.255783:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.255800:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.255815:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864978.255890:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787864978.255895:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864978.255945:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.255975:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a60 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.256011:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a60 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.256022:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:1.0:1787864978.256026:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864978.256031:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031600, rc 0) 00000100:00100000:1.0:1787864978.256528:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071293056:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 911us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.256537:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:0.0:1787864978.266656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.266750:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293184 00000100:00100000:3.0:1787864978.266763:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293184 00000100:00100000:3.0:1787864978.266843:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:3.0:1787864978.266855:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071293184:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864978.266879:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.266905:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192145 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267004:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267022:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267058:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267076:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267084:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267091:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267478:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267487:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267494:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864978.267537:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787864978.267542:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864978.267563:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267577:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267596:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267615:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267622:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267629:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.267634:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267643:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267658:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864978.267662:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.267668:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267674:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619214c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267689:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267696:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267703:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267708:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.267719:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267725:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267733:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864978.267736:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.267739:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267745:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe186192153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267783:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192145 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a67 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267798:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a67 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.267806:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.267808:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864978.267811:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864978.267899:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10536:x1874712071293184:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1047us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.267908:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:3.0:1787864978.272578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.272642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.272791:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293312 00000100:00100000:1.0:1787864978.272804:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293312 00000100:00100000:2.0:1787864978.272833:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293568 00000100:00100000:2.0:1787864978.272837:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293568 00000100:00100000:2.0:1787864978.272889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:1.0:1787864978.272889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787864978.272900:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10536:x1874712071293568:12345-192.168.206.10@tcp:101:lfs.0 00000100:00100000:1.0:1787864978.272900:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:2359:x1874712071293312:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864978.272925:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864978.272937:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864978.272957:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619215a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a67 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.272958:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a6e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.272980:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864978.272985:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864978.273064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:2359:x1874712071293312:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.273073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:2.0:1787864978.273085:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.273100:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.273109:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.273372:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.273389:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 55 pid: 5850 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.273446:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087034368:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864978.273530:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864978.280165:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087034368:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864978.280209:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864978.284987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.285980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293696 00000100:00100000:2.0:1787864978.285995:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293696 00010000:00010000:2.0:1787864978.286053:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 56 pid: 5850 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.286204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787864978.286226:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+56:2359:x1874712071293696:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864978.286246:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864978.286255:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 56 pid: 5850 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286271:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 56 pid: 5850 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286301:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a59 expref: 56 pid: 5850 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286323:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864978.286329:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286353:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286362:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.286475:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864978.286548:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+55:2359:x1874712071293696:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 333us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.286556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00010000:00010000:0.0:1787864978.286635:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.286645:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864978.286668:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787864978.287238:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.287260:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.287268:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864978.287271:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864978.287273:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581400, rc 0) 00000100:00100000:1.0:1787864978.287332:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10536:x1874712071293568:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 14433us (14689us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787864978.287339:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:1.0:1787864978.290888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.290990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071293952 00000100:00100000:3.0:1787864978.291003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071293952 00000100:00100000:3.0:1787864978.291179:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787864978.291192:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10536:x1874712071293952:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:3.0:1787864978.291221:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864978.291253:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe1861920c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a44 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.291274:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.291280:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864978.291345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071293952:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 156us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.291353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787864978.295083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.295275:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294080 00000100:00100000:3.0:1787864978.295290:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294080 00000100:00100000:3.0:1787864978.295368:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:3.0:1787864978.295390:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071294080:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:3.0:1787864978.295575:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.295608:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.295622:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864978.295872:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787864978.295982:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071294080:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 595us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.296482:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:1.0:1787864978.304492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.304699:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294208 00000100:00100000:3.0:1787864978.304711:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294208 00000100:00100000:3.0:1787864978.304793:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787864978.304805:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+54:10536:x1874712071294208:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864978.304834:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.304873:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.304966:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.304996:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.305023:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.305040:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.305058:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864978.305061:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864978.305066:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.305075:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350400, rc 0) 00000100:00100000:3.0:1787864978.305618:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10536:x1874712071294208:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 813us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.305627:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:2.0:1787864978.428685:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087034496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.428761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864978.428820:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087035008:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.428847:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864978.428871:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787864978.428876:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087034624:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.428897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864978.428911:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087035136:0@lo:400:kworker.0 00000100:00100000:0.0:1787864978.429025:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087034496 00000100:00100000:0.0:1787864978.429032:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087034496 00000100:00100000:0.0:1787864978.429075:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787864978.429083:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864978.429164:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087034880:0@lo:400:kworker.0 00000100:00100000:3.0:1787864978.429242:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087034752:0@lo:400:kworker.0 00000100:00100000:0.0:1787864978.429563:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087034496:12345-0@lo:400:kworker.0 Request processed in 479us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.429571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787864978.429616:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087035008 00000100:00100000:0.0:1787864978.429620:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087035008 00000100:00080000:0.0:1787864978.429640:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864978.429666:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087034624 00000100:00100000:0.0:1787864978.429670:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087034624 00000100:00100000:0.0:1787864978.429756:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787864978.429763:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087035008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864978.429798:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087035008:12345-0@lo:400:kworker.0 Request processed in 36us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.429804:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787864978.429816:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787864978.429822:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864978.429848:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087034624:12345-0@lo:400:kworker.0 Request processed in 26us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.429854:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787864978.431599:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864978.431665:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087034880 00000100:00100000:1.0:1787864978.431671:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087034880 00000100:00100000:1.0:1787864978.431860:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864978.431869:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864978.431931:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087034880:12345-0@lo:400:kworker.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00080000:0.0:1787864978.432149:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864978.433854:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087034880:0@lo:400:kworker.0 00000100:00100000:1.0:1787864978.434501:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787864978.434897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864978.436147:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20353c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087034496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.436169:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087035008:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.436762:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087034624:0@lo:400:kworker.0 00000100:00100000:3.0:1787864978.438150:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864978.439062:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087035136 00000100:00100000:1.0:1787864978.439186:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087035136 00000100:00100000:1.0:1787864978.440032:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864978.440046:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1874712087035136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864978.440124:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1874712087035136:12345-0@lo:400:kworker.0 Request processed in 82us (5227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.440132:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864978.440192:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087034752 00000100:00100000:0.0:1787864978.440197:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087034752 00000100:00080000:0.0:1787864978.440220:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864978.440248:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787864978.440255:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087034752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864978.440297:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087034752:12345-0@lo:400:kworker.0 Request processed in 43us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.440315:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787864978.440435:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087035136:0@lo:400:kworker.0 00000100:00100000:2.0:1787864978.440482:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087034752:0@lo:400:kworker.0 00010000:00010000:0.0:1787864978.491610:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864978.595484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.595532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.595563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.595649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294336 00000100:00100000:3.0:1787864978.595658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294336 00000100:00100000:3.0:1787864978.595715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00100000:3.0:1787864978.595725:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071294336:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864978.595789:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071294336:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.595797:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00100000:2.0:1787864978.595875:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294592 00000100:00100000:2.0:1787864978.595880:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294592 00000100:00100000:2.0:1787864978.595940:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:2.0:1787864978.595947:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071294592:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864978.595980:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071294592:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.595986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00080000:3.0:1787864978.596150:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864978.596262:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294464 00000100:00100000:0.0:1787864978.596267:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294464 00000100:00100000:0.0:1787864978.596316:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:0.0:1787864978.596323:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071294464:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864978.596352:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071294464:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.596357:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00080000:3.0:1787864978.596476:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787864978.683676:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864978.683685:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864978.683725:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787864978.683731:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864978.683857:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087035264:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864978.684032:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51480 going to sleep for 11 seconds 00000100:00100000:0.0:1787864978.686852:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087035264:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864978.687546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.687623:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294720 00000100:00100000:0.0:1787864978.687630:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294720 00000100:00100000:0.0:1787864978.687721:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:0.0:1787864978.687732:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10537:x1874712071294720:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787864978.687761:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787864978.687853:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10537:x1874712071294720:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.687860:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:1.0:1787864978.702409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.706300:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071294848 00000100:00100000:0.0:1787864978.706315:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071294848 00000100:00100000:1.0:1787864978.706530:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:1.0:1787864978.706555:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10537:x1874712071294848:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787864978.706637:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706655:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706676:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706692:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706698:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706704:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706727:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706736:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706742:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864978.706780:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787864978.706785:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864978.706797:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706820:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706826:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706833:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706839:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864978.706843:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706850:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706862:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:1.0:1787864978.706865:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864978.706869:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706874:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192184 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706887:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706892:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706898:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706909:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864978.706913:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706919:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706928:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fa211170d00) 00010000:00010000:1.0:1787864978.706930:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864978.706933:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706939:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619218b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706956:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706961:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706966:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706971:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864978.706973:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706978:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.706995:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864978.706998:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864978.707001:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.707006:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864978.707093:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10537:x1874712071294848:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 539us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.707101:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:1.0:1787864978.709839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.709935:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071295104 00000100:00100000:2.0:1787864978.709944:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071295104 00000100:00100000:2.0:1787864978.709996:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:2.0:1787864978.710006:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+55:10537:x1874712071295104:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.710024:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864978.710046:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192199 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a7c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710136:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710149:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710160:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864978.710172:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787864978.710282:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710290:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710310:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710316:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864978.710320:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710328:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710340:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864978.710343:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864978.710348:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710355:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710435:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192199 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a7c expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710445:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:2.0:1787864978.710448:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864978.710452:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192199 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a7c expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.710461:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580600, rc 0) 00000100:00100000:2.0:1787864978.710525:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295104:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 521us (695us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787864978.710541:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:3.0:1787864978.717679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.718538:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071295232 00000100:00100000:0.0:1787864978.718552:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071295232 00000100:00100000:0.0:1787864978.718630:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:0.0:1787864978.718641:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295232:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787864978.718675:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787864978.718791:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295232:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 152us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.718799:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:1.0:1787864978.723694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.724074:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071295488 00000100:00100000:0.0:1787864978.724126:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071295488 00000100:00100000:0.0:1787864978.724234:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787864978.724261:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295488:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864978.724282:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864978.724285:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864978.724312:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619213e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a60 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.724334:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:0.0:1787864978.724338:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864978.724353:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe1861921ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864978.724889:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787864978.725301:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861921b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.725316:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861921b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.725326:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861921b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.725477:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe1861921ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a83 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.725536:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861921b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a83 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.725544:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa20378bf00) 00010000:00010000:0.0:1787864978.725557:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864978.725561:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493400, rc 0) 00000100:00100000:0.0:1787864978.725666:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+57:10537:x1874712071295488:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1422us (1986us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787864978.725710:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787864978.736091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.736180:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071295744 00000100:00100000:3.0:1787864978.736196:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071295744 00000100:00100000:3.0:1787864978.736289:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:3.0:1787864978.736301:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+57:10537:x1874712071295744:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787864978.736517:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864978.736555:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861921b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a83 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.736590:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa20378bf00) 00010000:00010000:3.0:1787864978.736603:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864978.736631:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.736648:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.736682:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743203:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743227:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743240:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743324:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743332:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743339:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743345:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.743350:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743358:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743370:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787864978.743373:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.743378:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743424:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743438:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743445:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743451:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743456:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864978.743459:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743465:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743473:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb55372c6 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864978.743476:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864978.743479:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.743485:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb55372c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864978.745960:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295744:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 9651us (9868us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864978.745972:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:0.0:1787864978.754275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.754365:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071295872 00000100:00100000:2.0:1787864978.754376:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071295872 00000100:00100000:2.0:1787864978.754617:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:2.0:1787864978.754638:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+56:10537:x1874712071295872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.754658:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864978.754682:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe1861921d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a8a expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754718:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754731:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754741:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754848:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe1861921d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 58 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754863:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 57 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.754871:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:2.0:1787864978.754874:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864978.754877:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580200, rc 0) 00000100:00100000:2.0:1787864978.754971:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+57:10537:x1874712071295872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 345us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.754986:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:0.0:1787864978.761599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.761774:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071296128 00000100:00100000:2.0:1787864978.761784:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071296128 00000100:00100000:2.0:1787864978.761848:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:2.0:1787864978.761858:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+57:10537:x1874712071296128:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.761949:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.761965:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.761976:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864978.762199:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787864978.762208:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294701810867ns, next at 295701808598ns, rc = 0 00000004:00010000:2.0:1787864978.762293:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff154b45 reply state 000000003ecbd04c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.762301:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864978.762387:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+59:10537:x1874712071296128:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 531us (809us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787864978.762416:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:1.0:1787864978.764890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787864978.764968:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.764981:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.764988:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.764993:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864978.764998:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.765005:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.765040:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:0.0:1787864978.765043:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787864978.765048:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.765054:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe1861921df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.766144:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071296256 00000100:00100000:2.0:1787864978.766156:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071296256 00000100:00100000:2.0:1787864978.766204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:2.0:1787864978.766214:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+58:10537:x1874712071296256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.766237:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864978.766269:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a91 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.766330:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.766342:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.766362:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:2.0:1787864978.766365:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864978.766367:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581000, rc 0) 00000100:00100000:2.0:1787864978.766472:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+59:10537:x1874712071296256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 259us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.766479:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787864978.773746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.773838:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071296384 00000100:00100000:0.0:1787864978.773852:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071296384 00000100:00100000:0.0:1787864978.773914:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787864978.773925:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071296384:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787864978.774215:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071296384:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 291us (482us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787864978.774223:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787864978.782191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.783008:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071296640 00000100:00100000:2.0:1787864978.783018:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071296640 00000100:00100000:2.0:1787864978.783078:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787864978.783088:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+59:10537:x1874712071296640:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787864978.783326:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+60:10537:x1874712071296640:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 240us (1144us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787864978.783334:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787864978.791098:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.791189:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071296896 00000100:00100000:1.0:1787864978.791198:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071296896 00000100:00100000:1.0:1787864978.791254:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:1.0:1787864978.791264:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+60:10537:x1874712071296896:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864978.791382:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+60:10537:x1874712071296896:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 119us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.791389:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787864978.797451:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.797623:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297024 00000100:00100000:3.0:1787864978.797632:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297024 00000100:00100000:3.0:1787864978.797704:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:3.0:1787864978.797715:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+60:10537:x1874712071297024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864978.797734:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.797754:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a98 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798079:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798094:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798106:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864978.798145:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864978.798163:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798188:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861921ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a98 expref: 62 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798205:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a98 expref: 61 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.798214:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:3.0:1787864978.798218:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787864978.798234:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351600, rc 0) 00000100:00100000:3.0:1787864978.798347:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+61:10537:x1874712071297024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 634us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.798356:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:0.0:1787864978.804487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.804602:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297152 00000100:00100000:2.0:1787864978.804612:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297152 00000100:00100000:2.0:1787864978.804664:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787864978.804674:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2358:x1874712071297152:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.804704:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864978.804728:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7a9f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864978.804756:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a793, blocks: 0x1 00010000:00010000:2.0:1787864978.804778:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1787864978.804782:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864978.804799:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.804815:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.804830:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580c00, rc 0) 00000100:00100000:2.0:1787864978.804896:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071297152:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 223us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.804903:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787864978.815150:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.815649:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297408 00000100:00100000:0.0:1787864978.815659:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297408 00000100:00100000:0.0:1787864978.815727:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:0.0:1787864978.815738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+61:10537:x1874712071297408:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787864978.815880:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+61:10537:x1874712071297408:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 143us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.815887:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:0.0:1787864978.819319:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.819451:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297536 00000100:00100000:3.0:1787864978.819467:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297536 00000100:00100000:3.0:1787864978.819522:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787864978.819532:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+10:10537:x1874712071297536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864978.819550:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864978.819570:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7aa6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.819611:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.819621:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864978.820279:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864978.820303:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.820649:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.820665:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 11 pid: 6694 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.820681:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1874712087035392:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864978.821552:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864978.831319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.831437:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297664 00000100:00100000:3.0:1787864978.831446:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297664 00010000:00010000:3.0:1787864978.831498:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 12 pid: 6694 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864978.831540:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:3.0:1787864978.831550:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+12:2358:x1874712071297664:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864978.831590:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864978.831615:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 12 pid: 6694 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.831640:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 12 pid: 6694 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.831665:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864978.831670:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864978.831678:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.832020:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.832060:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864978.832073:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc32580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874712087035520:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787864978.832149:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22f52c6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787864978.832482:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f84499/0xa63eebe1861921fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a9f expref: 12 pid: 6694 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864978.832506:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1874712087035392:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864978.832531:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864978.832543:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:0.0:1787864978.832590:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+11:10537:x1874712071297536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 13059us (13279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864978.832599:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787864978.841892:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc32580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874712087035520:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787864978.841934:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864978.841999:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071297664:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 10450us (10689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864978.842010:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:1.0:1787864978.842943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864978.843064:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297792 00000100:00100000:0.0:1787864978.843071:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297792 00002000:00100000:0.0:1787864978.843108:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa22f3f6580 x1874712071297792/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:74/0 lens 504/0 e 0 to 0 dl 1787864989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864978.843118:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f3f6580 with x1874712071297792 ext(0->12) 00002000:00010000:0.0:1787864978.843123:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f3f6580 00000100:00100000:0.0:1787864978.843155:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787864978.843163:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071297792:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787864978.844095:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+12:2358:x1874712071297792:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 927us (1150us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787864978.844106:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:0.0:1787864978.844114:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa22f3f6580 x1874712071297792/t4294967308(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:74/0 lens 504/448 e 0 to 0 dl 1787864989 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864978.844123:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f3f6580 with x1874712071297792 ext(0->12) 00002000:00010000:0.0:1787864978.844133:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f3f6580 00000100:00100000:1.0:1787864978.846567:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.846672:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071297920 00000100:00100000:2.0:1787864978.846680:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071297920 00000100:00100000:2.0:1787864978.846742:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:2.0:1787864978.846750:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+61:10537:x1874712071297920:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787864978.922981:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+61:10537:x1874712071297920:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 76222us (76412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.923010:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000001:00080000:0.0:1787864978.923830:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:0.0:1787864978.923856:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787864978.923883:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2048a4e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787864978.923888:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa23bc2c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2048a40c0 00000020:00080000:0.0:1787864978.923891:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa23bc2c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa22f437c00 00000001:00080000:0.0:1787864978.923936:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787864978.923947:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787864978.923991:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787864978.924012:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2048a4a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787864978.924015:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa203fa3b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2048a46c0 00000020:00080000:0.0:1787864978.924017:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa203fa3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa23b341c00 00000100:00100000:0.0:1787864978.924058:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087035648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787864978.924110:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864978.924471:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087035904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787864978.924502:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864978.924541:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087035648 00000100:00100000:3.0:1787864978.924548:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087035648 00000100:00100000:3.0:1787864978.924597:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087035904 00000100:00100000:3.0:1787864978.924601:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087035904 00000100:00100000:3.0:1787864978.924622:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864978.924638:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3317:x1874712087035648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787864978.924663:0:8906:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787864978.924695:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90a792, atime: 0x6a90a792, ctime: 0x6a90a792, blocks: 0x1 00010000:00010000:3.0:1787864978.924703:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.924718:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=294s v=(0 0) 00010000:00010000:3.0:1787864978.924722:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864978.924729:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.924746:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.924755:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.924763:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.924780:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864978.925309:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3317:x1874712087035648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 678us (1197us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787864978.925317:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864978.925336:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864978.925344:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1874712087035904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787864978.925475:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787864978.925479:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787864979 00002000:00010000:3.0:1787864978.925482:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787864978.925484:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787864979 -> 1787864979 00002000:00010000:3.0:1787864978.925487:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787864978.925519:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1874712087035904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (1015us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787864978.925525:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787864978.925546:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864978.925552:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.925560:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864978.925563:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.925572:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.925601:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.925619:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192209 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.925638:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864978.925640:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864978.925642:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787864978.925674:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa23bc312c0/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787864978.925680:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087035904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787864978.925704:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22f3f7840/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787864978.925709:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087035648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787864978.925716:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864978.925722:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087035776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864978.925750:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864978.925779:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087035776 00000100:00100000:1.0:1787864978.925784:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087035776 00000100:00100000:1.0:1787864978.925815:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864978.925823:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1874712087035776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787864978.925837:0:6694:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787864978.925852:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.925867:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.925874:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787864978.925878:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864978.925881:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.925907:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.925919:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 11 pid: 8906 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864978.925931:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087036032:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864978.925983:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51180 going to sleep for 11 seconds 00000020:00080000:2.0:1787864978.926432:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787864978.926599:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787864978.932313:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864978.932917:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298048 00000100:00100000:3.0:1787864978.932927:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298048 00000100:00100000:3.0:1787864978.933102:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787864978.933114:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+12:2358:x1874712071298048:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787864978.933680:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864978.934141:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298176 00000100:00100000:1.0:1787864978.934148:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298176 00010000:00010000:1.0:1787864978.934179:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 13 pid: 8906 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864978.934210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:1.0:1787864978.934218:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2358:x1874712071298176:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864978.934229:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864978.934235:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 13 pid: 8906 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.934249:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 13 pid: 8906 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.934275:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864978.934279:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864978.934286:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.934296:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864978.934316:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864978.934362:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2358:x1874712071298176:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 145us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.934384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00010000:00010000:2.0:1787864978.934807:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186191fcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a05 expref: 12 pid: 8906 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.934825:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087036032:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864978.934844:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.934854:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.934861:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.934869:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.934877:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.934908:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787864978.935458:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1874712087035776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9634us (9705us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787864978.935468:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1787864978.935618:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa23bc32580/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787864978.935625:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087035776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787864978.936474:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864978.936484:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.936496:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864978.936512:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.936523:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.936540:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.936548:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192210 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864978.936589:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864978.936591:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864978.936593:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864978.964104:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864978.964124:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087036160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864978.964184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864978.966736:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087036160 00000100:00100000:1.0:1787864978.966747:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087036160 00000100:00100000:1.0:1787864978.966817:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864978.966828:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3315:x1874712087036160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864978.966852:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864978.967143:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3315:x1874712087036160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 316us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864978.967152:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787864978.967255:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087036160:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787864978.991036:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787864978.991063:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1787864978.991512:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071298048:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 58395us (59203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864978.991524:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787864978.994381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864978.994608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298432 00000100:00100000:2.0:1787864978.994617:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298432 00000100:00100000:2.0:1787864978.994681:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:2.0:1787864978.994692:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10537:x1874712071298432:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864978.994744:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864978.994768:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861921f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a98 expref: 15 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.994785:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:2.0:1787864978.994802:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864978.994831:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.994844:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864978.994872:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864978.995104:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d956e329 reply state 0000000004018e56 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864978.995114:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864978.995554:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+16:10537:x1874712071298432:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 862us (1179us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787864978.995561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00010000:00010000:2.0:1787864979.000751:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000769:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000775:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000781:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864979.000786:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000803:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000820:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:2.0:1787864979.000824:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864979.000829:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.000852:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192217 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.001344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864979.001440:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298560 00000100:00100000:3.0:1787864979.001450:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298560 00000100:00100000:3.0:1787864979.001505:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787864979.001515:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071298560:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787864979.001922:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787864979.001926:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787864979 -> 1787864978 00002000:00010000:3.0:1787864979.001929:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787864978 00002000:00010000:3.0:1787864979.001931:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787864979 -> 1787864978 00002000:00010000:3.0:1787864979.001934:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787864979.002039:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071298560:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 524us (699us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787864979.002048:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787864979.013514:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.015043:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298816 00000100:00100000:2.0:1787864979.015056:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298816 00000100:00100000:2.0:1787864979.015149:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:2.0:1787864979.015159:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+15:10537:x1874712071298816:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787864979.015223:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.015238:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 15 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.015247:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.015277:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 15 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.015290:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 15 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.015302:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087036288:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864979.015415:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3dcc0 going to sleep for 11 seconds 00000100:00080000:3.0:1787864979.015714:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864979.018461:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087036288:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864979.018495:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.019642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.019773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071298944 00000100:00100000:2.0:1787864979.019780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071298944 00010000:00010000:2.0:1787864979.019827:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 16 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.019864:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787864979.019874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+16:2358:x1874712071298944:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864979.019889:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864979.019897:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 16 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.019911:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 16 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.019935:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861921d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a8a expref: 16 pid: 10329 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.019949:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:2.0:1787864979.019954:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.019964:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.019971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.020002:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864979.020059:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:2358:x1874712071298944:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 186us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864979.020067:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00010000:00010000:1.0:1787864979.020555:0:10329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020564:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020600:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020607:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020613:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020619:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864979.020639:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020647:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020657:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:1.0:1787864979.020660:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787864979.020664:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.020670:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619221e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.020727:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10537:x1874712071298816:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 5568us (7227us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787864979.020735:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:1.0:1787864979.022563:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.022729:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299072 00000100:00100000:2.0:1787864979.022737:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299072 00000100:00100000:2.0:1787864979.022800:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787864979.022811:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071299072:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787864979.022854:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.022874:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.022883:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864979.022887:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864979.022892:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.022935:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.022949:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 7 pid: 6696 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.022963:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087036416:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864979.023037:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864979.029924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864979.029992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299200 00000100:00100000:1.0:1787864979.030000:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299200 00010000:00010000:1.0:1787864979.030040:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 8 pid: 6696 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.030084:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787864979.030093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071299200:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864979.030106:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864979.030128:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 8 pid: 6696 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.030169:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 8 pid: 6696 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.030193:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864979.030198:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864979.030204:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.030215:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.030236:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864979.030289:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071299200:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 197us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864979.030297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00010000:00010000:2.0:1787864979.030614:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192202 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aa6 expref: 7 pid: 6696 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.030629:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23baa12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087036416:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864979.030660:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030671:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030679:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030703:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030711:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030719:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030726:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864979.030730:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030751:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030763:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.030771:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001502a74/0xa63eebe186192225 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.030820:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071299072:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 8010us (8262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864979.030827:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787864979.041317:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864979.041440:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299456 00000100:00100000:1.0:1787864979.041449:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299456 00000100:00100000:1.0:1787864979.041498:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:1.0:1787864979.041507:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10537:x1874712071299456:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787864979.041587:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041603:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041615:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041828:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041839:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041846:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041876:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.041890:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 15 pid: 5849 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.041904:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087036544:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864979.041983:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864979.046522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864979.046609:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299584 00000100:00100000:3.0:1787864979.046619:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299584 00010000:00010000:3.0:1787864979.046707:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 16 pid: 5849 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864979.046750:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787864979.046761:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+16:2359:x1874712071299584:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864979.046776:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864979.046782:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 16 pid: 5849 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864979.046794:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 16 pid: 5849 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864979.046816:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:3.0:1787864979.046822:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864979.046831:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864979.046838:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864979.046856:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864979.046915:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+16:2359:x1874712071299584:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 156us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864979.046922:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00010000:00010000:1.0:1787864979.048200:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581000/0xa63eebe1861921e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a91 expref: 15 pid: 5849 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.048220:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087036544:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864979.048241:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.048250:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.048256:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864979.048487:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787864979.048648:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787864979.048694:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787864979.048775:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087036672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787864979.048841:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864979.048869:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864979.051347:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087036672 00000100:00100000:3.0:1787864979.051360:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087036672 00000100:00100000:3.0:1787864979.051456:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787864979.051467:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087036672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864979.051591:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087036672:12345-0@lo:1000:mdt00_001.0 Request processed in 127us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864979.051599:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864979.052544:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787864979.052553:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787864979.052573:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa23bc312c0, transno 4294967309 00000004:00080000:1.0:1787864979.052597:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa23bc32580, transno 4294967310 00000100:00100000:1.0:1787864979.052606:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087036672:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787864979.053097:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787864979.053447:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd61680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087036800:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787864979.053500:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864979.053528:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864979.053606:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087036800 00000100:00100000:2.0:1787864979.053611:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087036800 00000100:00100000:2.0:1787864979.053654:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864979.053662:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874712087036800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787864979.053829:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874712087036800:12345-0@lo:1000:mdt00_001.0 Request processed in 167us (328us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787864979.053837:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864979.053963:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd61680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1874712087036800:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787864979.053994:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054011:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054019:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054025:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864979.054030:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054038:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054052:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa206f51300) 00010000:00010000:0.0:1787864979.054055:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864979.054059:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054066:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe186192233 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054094:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054101:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054107:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054111:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864979.054120:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054126:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054133:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787864979.054146:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864979.054152:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054163:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054172:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864979.054195:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864979.054206:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd60f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087036928:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787864979.054266:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864979.058071:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd60f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087036928:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787864979.058101:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058113:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192176 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058173:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058186:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058197:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058206:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058212:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058219:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058224:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864979.058228:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058235:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058246:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864979.058249:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864979.058253:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058259:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619223a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058279:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058285:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058291:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058296:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864979.058299:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058306:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058314:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864979.058316:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864979.058319:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.058325:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619222c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.058603:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10537:x1874712071299456:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 17094us (17294us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787864979.058612:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000020:00080000:2.0:1787864979.058617:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787864979.059076:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864979.059082:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864979.059601:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787864979.059612:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787864979.066016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.066110:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864979.066423:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299712 00000100:00100000:1.0:1787864979.066431:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299712 00000100:00100000:1.0:1787864979.066471:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071299968 00000100:00100000:1.0:1787864979.066475:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071299968 00000100:00100000:1.0:1787864979.066494:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:1.0:1787864979.066505:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10536:x1874712071299712:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:1.0:1787864979.066644:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:10536:x1874712071299712:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 140us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864979.066651:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:1.0:1787864979.066670:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:1.0:1787864979.066676:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:10537:x1874712071299968:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787864979.067298:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787864979.067440:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787864979.067489:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067505:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067518:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067526:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067532:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067538:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.067553:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787864979.067627:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+20:10537:x1874712071299968:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 950us (1516us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787864979.067636:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000020:00080000:1.0:1787864979.067639:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787864979.067898:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864979.067905:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.067913:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864979.067918:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.067926:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.067939:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa211170d00) 00010000:00010000:2.0:1787864979.067942:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787864979.067946:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.067953:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192241 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.067970:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864979.067972:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864979.067974:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864979.076226:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864979.076312:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071300224 00000100:00100000:0.0:1787864979.076323:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071300224 00000100:00100000:0.0:1787864979.076385:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:0.0:1787864979.076436:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:10536:x1874712071300224:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:0.0:1787864979.076695:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787864979.076785:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:10536:x1874712071300224:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 351us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864979.076794:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:3.0:1787864979.107144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864979.107279:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071300352 00000100:00100000:1.0:1787864979.107296:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071300352 00000100:00100000:1.0:1787864979.107379:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:1.0:1787864979.107391:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+20:10539:x1874712071300352:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864979.107470:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864979.107493:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7aad expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107585:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107600:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107612:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107627:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107646:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107653:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107965:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107977:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.107986:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.108234:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.108262:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 21 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864979.108347:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087037056:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864979.108468:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864979.114511:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087037056:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864979.114540:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864979.115030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.115115:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071300608 00000100:00100000:2.0:1787864979.115124:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071300608 00000100:00100000:2.0:1787864979.115192:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787864979.115203:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:5592:x1874712071300608:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787864979.115688:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+23:5592:x1874712071300608:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 485us (665us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787864979.115697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:1.0:1787864979.119508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864979.119624:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071300736 00000100:00100000:2.0:1787864979.119695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071300736 00010000:00010000:2.0:1787864979.119738:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 23 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864979.119782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787864979.119792:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+23:2358:x1874712071300736:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864979.119806:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864979.119812:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 23 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119826:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 23 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119847:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192168 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a6e expref: 23 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119864:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864979.119870:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119879:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119887:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864979.119920:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864979.119987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+22:2358:x1874712071300736:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 196us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864979.119995:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00010000:00010000:1.0:1787864979.120053:0:10329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120062:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864979.120102:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787864979.120107:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864979.120126:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120149:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120159:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120166:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120172:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120178:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864979.120191:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120199:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120209:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:1.0:1787864979.120212:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864979.120215:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120221:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe18619224f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120233:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120239:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120245:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120251:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864979.120254:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120260:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120267:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa211170500) 00010000:00010000:1.0:1787864979.120270:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864979.120279:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120285:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe186192256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120321:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aad expref: 22 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120334:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aad expref: 21 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864979.120341:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864979.120343:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864979.120346:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200030600, rc 0) 00000100:00100000:1.0:1787864979.120370:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10539:x1874712071300352:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 12983us (13241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864979.120377:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00010000:00010000:2.0:1787864979.518712:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787864979.567106:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787864979.567126:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787864979.567146:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787864979.567154:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:0.0:1787864980.093222:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864980.093231:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864980.093281:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787864980.093289:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864980.095016:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd60f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087037184:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787864980.095165:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864980.107794:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd60f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087037184:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864980.109954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000040:00080000:3.0:1787864980.110246:0:12050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864980.110251:0:12050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864980.110289:0:12050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787864980.110295:0:12050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787864980.110577:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071300864 00000100:00100000:2.0:1787864980.110587:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071300864 00000100:00100000:2.0:1787864980.110637:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:2.0:1787864980.110649:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10551:x1874712071300864:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864980.110695:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864980.110808:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10551:x1874712071300864:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 161us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864980.110815:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:3.0:1787864980.119954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864980.120020:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071301120 00000100:00100000:2.0:1787864980.120029:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071301120 00000100:00100000:2.0:1787864980.120075:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:2.0:1787864980.120085:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+21:10551:x1874712071301120:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864980.120104:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864980.120125:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192264 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ab4 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864980.120222:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe18619226b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864980.120236:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe18619226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864980.120258:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe18619226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864980.120270:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787864980.120425:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192264 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ab4 expref: 24 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864980.120443:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe18619226b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ab4 expref: 23 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864980.120451:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787864980.120454:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864980.120458:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580200, rc 0) 00000100:00100000:2.0:1787864980.120508:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+23:10551:x1874712071301120:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 425us (561us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787864980.120516:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:0.0:1787864980.148162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864980.148278:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071301248 00000100:00100000:3.0:1787864980.148287:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071301248 00000100:00100000:3.0:1787864980.148351:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787864980.148361:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+23:2357:x1874712071301248:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864980.148375:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864980.148428:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe18619226b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ab4 expref: 23 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864980.148445:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787864980.148449:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864980.148494:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+22:2357:x1874712071301248:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864980.148501:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787864980.153268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864980.153305:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071301504 00000100:00100000:1.0:1787864980.153313:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071301504 00000100:00100000:1.0:1787864980.153357:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 132 00000100:00100000:1.0:1787864980.153379:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+22:10551:x1874712071301504:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787864980.153471:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153487:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153499:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153699:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153708:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153715:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153721:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864980.153725:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153732:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153745:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864980.153748:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864980.153754:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864980.153760:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864980.155042:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+23:10551:x1874712071301504:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 1670us (1775us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787864980.155054:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 132 00000040:00080000:0.0:1787864980.155314:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864980.155320:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864980.156560:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787864980.156589:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864980.174345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864980.175367:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071301760 00000100:00100000:0.0:1787864980.175378:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071301760 00000100:00100000:0.0:1787864980.175455:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787864980.175465:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+23:10551:x1874712071301760:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864980.175690:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+24:10551:x1874712071301760:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 226us (1354us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787864980.175710:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00010000:00010000:3.0:1787864980.539545:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864981.499974:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087037312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864981.500187:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864981.500275:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037312 00000100:00100000:2.0:1787864981.500287:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037312 00000100:00100000:2.0:1787864981.500378:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787864981.500391:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087037312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864981.500473:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787864981.500547:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd60f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087037312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864981.500556:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787864981.500619:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087037312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864981.501443:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787864981.563695:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864981.985496:0:12101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864981.985506:0:12101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864981.985569:0:12101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787864981.985575:0:12101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864982.168532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864982.168679:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302016 00000100:00100000:1.0:1787864982.168693:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302016 00000100:00100000:1.0:1787864982.168768:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:1.0:1787864982.168779:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:10572:x1874712071302016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864982.168808:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864982.168833:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7abb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787864982.169054:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787864982.169126:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192287 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864982.169144:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864982.169161:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864982.169175:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787864982.169336:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7abb expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864982.169358:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7abb expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864982.169368:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787864982.169371:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787864982.169375:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031c00, rc 0) 00000100:00100000:1.0:1787864982.169577:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+26:10572:x1874712071302016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 799us (1058us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787864982.169601:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:2.0:1787864982.176614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864982.176701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302144 00000100:00100000:0.0:1787864982.176714:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302144 00000100:00100000:0.0:1787864982.176792:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:0.0:1787864982.176803:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+26:10572:x1874712071302144:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787864982.176894:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.176923:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.176947:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.176980:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.176987:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.176995:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.177002:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864982.177007:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.177028:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.177042:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787864982.177046:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864982.177051:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.177057:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492200/0xa63eebe186192295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864982.177147:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+26:10572:x1874712071302144:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 346us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864982.177156:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:3.0:1787864982.261975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864982.262130:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302272 00000100:00100000:0.0:1787864982.262143:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302272 00000100:00100000:0.0:1787864982.262234:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787864982.262245:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071302272:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787864982.262267:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864982.262290:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201f6930/0xa63eebe18619229c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ac2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864982.262325:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90a792, atime: 0x6a90a792, ctime: 0x6a90a792, blocks: 0xb 00010000:00010000:0.0:1787864982.262350:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1787864982.262367:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864982.262378:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201f6930/0xa63eebe18619229c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac2 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.262467:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000201f6930/0xa63eebe18619229c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac2 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864982.262484:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492200, rc 0) 00000100:00100000:0.0:1787864982.262568:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071302272:12345-192.168.206.10@tcp:101:cat.0 Request processed in 315us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864982.262577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00080000:3.0:1787864982.262800:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864982.268955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864982.269633:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302400 00000100:00100000:1.0:1787864982.269656:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302400 00002000:00100000:1.0:1787864982.269728:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9fa23bc33c00 x1874712071302400/t0(0) o3->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:78/0 lens 488/0 e 0 to 0 dl 1787864993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787864982.269741:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23bc33c00 with x1874712071302400 ext(0->4095) 00002000:00010000:1.0:1787864982.269748:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23bc33c00 00000100:00100000:1.0:1787864982.269791:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787864982.269803:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071302400:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:1.0:1787864982.270882:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071302400:12345-192.168.206.10@tcp:3:cat.0 Request processed in 1073us (1940us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787864982.272833:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00002000:00100000:1.0:1787864982.272853:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9fa23bc33c00 x1874712071302400/t0(0) o3->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:78/0 lens 488/4536 e 0 to 0 dl 1787864993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787864982.272864:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23bc33c00 with x1874712071302400 ext(0->4095) 00002000:00010000:1.0:1787864982.272871:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23bc33c00 00010000:00010000:2.0:1787864982.587794:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864983.547986:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087037824:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548134:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787864983.548140:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087037440:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548167:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548189:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087037952:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548209:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548242:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087037568:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548275:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087038080:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548291:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548306:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864983.548311:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087037696:0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864983.548357:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037824 00000100:00100000:1.0:1787864983.548363:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037824 00000100:00100000:1.0:1787864983.548429:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038080 00000100:00100000:1.0:1787864983.548432:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038080 00000100:00100000:1.0:1787864983.548451:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864983.548459:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087037824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548506:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087037824:12345-0@lo:400:kworker.0 Request processed in 49us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.548513:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864983.548526:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787864983.548532:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087038080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548568:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087038080:12345-0@lo:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.548573:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787864983.548590:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037952 00000100:00100000:1.0:1787864983.548593:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037952 00000100:00100000:1.0:1787864983.548614:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037568 00000100:00100000:1.0:1787864983.548616:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037568 00000100:00100000:1.0:1787864983.548628:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037696 00000100:00100000:1.0:1787864983.548630:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037696 00000100:00100000:1.0:1787864983.548642:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864983.548654:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087037952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548681:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087037952:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.548687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864983.548697:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787864983.548703:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087037568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548722:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087037568:12345-0@lo:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.548727:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787864983.548736:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787864983.548741:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087037696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864983.548759:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087037696:12345-0@lo:400:kworker.0 Request processed in 19us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.548765:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787864983.549128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087037440 00000100:00100000:0.0:1787864983.549133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087037440 00000100:00100000:0.0:1787864983.549159:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787864983.549166:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087037440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549198:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087037440:12345-0@lo:400:kworker.0 Request processed in 34us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864983.549205:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787864983.549260:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087037440:0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549272:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087037952:0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549281:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087037824:0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549320:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087037696:0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549329:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087037568:0@lo:400:kworker.0 00000100:00100000:0.0:1787864983.549337:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787864983.549342:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1787864983.549360:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa22ea35e00, transno 4294967301 00000004:00080000:0.0:1787864983.549374:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787864983.549385:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa22f3f7840, transno 4294967304 00000100:00100000:0.0:1787864983.549390:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087038080:0@lo:400:kworker.0 00000100:00080000:1.0:1787864983.550889:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864983.551770:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864983.551777:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787864983.611594:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864983.716567:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864983.716608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864983.716635:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864983.716655:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864983.716681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864983.716709:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302784 00000100:00100000:1.0:1787864983.716718:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302784 00000100:00100000:1.0:1787864983.716763:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302912 00000100:00100000:1.0:1787864983.716766:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302912 00000100:00100000:3.0:1787864983.716910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302528 00000100:00100000:3.0:1787864983.716914:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302528 00000100:00100000:3.0:1787864983.716945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:3.0:1787864983.716954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071302528:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864983.717022:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071302528:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864983.717030:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:1.0:1787864983.717179:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:1.0:1787864983.717187:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071302784:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864983.717237:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071302784:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 51us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.717244:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:1.0:1787864983.717256:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:1.0:1787864983.717262:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071302912:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864983.717283:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071302912:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.717289:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:1.0:1787864983.717305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303040 00000100:00100000:1.0:1787864983.717308:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303040 00000100:00100000:1.0:1787864983.717332:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071302656 00000100:00100000:1.0:1787864983.717335:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071302656 00000100:00100000:1.0:1787864983.717352:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787864983.717358:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071303040:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864983.717384:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071303040:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.717390:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787864983.717427:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:1.0:1787864983.717434:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+26:2358:x1874712071302656:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864983.717454:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+26:2358:x1874712071302656:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 22us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864983.717460:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00080000:3.0:1787864983.717988:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864983.717993:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864984.064680:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087038208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864984.064748:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864984.065151:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038208 00000100:00100000:3.0:1787864984.065160:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038208 00000100:00100000:3.0:1787864984.065219:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864984.065228:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087038208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864984.065262:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864984.065314:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23baa1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087038208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864984.065321:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864984.065428:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087038208:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787864984.155130:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1787864984.155156:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787864984.155177:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa23be51cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787864984.155184:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa210cc9000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa23be51b40 00000020:00080000:0.0:1787864984.155188:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa210cc9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa22f70c000 00000020:00080000:2.0:1787864984.156213:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1787864984.156443:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787864984.156520:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787864984.188107:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787864984.188135:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1787864984.636152:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864985.659577:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864986.624847:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087038336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864986.624914:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864986.624994:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038336 00000100:00100000:3.0:1787864986.625001:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038336 00000100:00100000:3.0:1787864986.625053:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864986.625062:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087038336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864986.625096:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864986.625138:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087038336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864986.625145:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787864986.625165:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864986.625191:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787864986.625196:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787864986.625221:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087038336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864986.690561:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864987.190146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864987.190555:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303168 00000100:00100000:0.0:1787864987.190568:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303168 00000100:00100000:0.0:1787864987.190659:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:0.0:1787864987.190816:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10225:x1874712071303168:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787864987.190967:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10225:x1874712071303168:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 157us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864987.190976:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00080000:3.0:1787864987.191081:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864987.198781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864987.199466:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303424 00000100:00100000:3.0:1787864987.199485:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303424 00000100:00100000:3.0:1787864987.199569:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787864987.199580:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:10225:x1874712071303424:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787864987.200223:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:10225:x1874712071303424:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 640us (1454us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787864987.200233:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787864987.661425:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864987.661962:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303552 00000100:00100000:1.0:1787864987.661976:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303552 00000100:00100000:1.0:1787864987.662123:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 136 00000100:00100000:1.0:1787864987.662137:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:11024:x1874712071303552:12345-192.168.206.10@tcp:101:lsof.0 00000100:00080000:3.0:1787864987.662146:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787864987.662163:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864987.662191:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ac9 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662286:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662303:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662321:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864987.662647:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787864987.662653:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864987.662766:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662799:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662820:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 6 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864987.662831:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864987.662835:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864987.662847:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200030800, rc 0) 00000100:00100000:1.0:1787864987.662936:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+6:11024:x1874712071303552:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 803us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864987.662945:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 136 00010000:00010000:2.0:1787864987.707696:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787864988.350206:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864988.350217:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787864988.351149:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787864988.351159:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864988.668041:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087038720:0@lo:400:kworker.0 00000100:00100000:3.0:1787864988.668106:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864988.668180:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787864988.668258:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087038848:0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668289:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864988.668308:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787864988.668313:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087038464:0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668333:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864988.668351:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f709680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087038976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668366:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864988.668391:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038848 00000100:00100000:1.0:1787864988.668413:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038848 00000100:00100000:1.0:1787864988.668465:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787864988.668474:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087038848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668519:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087038848:12345-0@lo:400:kworker.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864988.668550:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787864988.668588:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087038848:0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668619:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038720 00000100:00100000:1.0:1787864988.668623:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038720 00000100:00100000:1.0:1787864988.668647:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038976 00000100:00100000:1.0:1787864988.668650:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038976 00000100:00100000:1.0:1787864988.668667:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787864988.668673:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087038720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668702:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087038720:12345-0@lo:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864988.668716:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787864988.668728:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787864988.668734:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087038976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.668765:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087038976:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864988.668771:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787864988.668794:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f709680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087038976:0@lo:400:kworker.0 00000100:00080000:1.0:1787864988.668815:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864988.668819:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864988.668973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038464 00000100:00100000:0.0:1787864988.668977:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038464 00000100:00100000:0.0:1787864988.669011:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787864988.669018:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864988.669050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087038464:12345-0@lo:400:kworker.0 Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864988.669066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787864988.669206:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f70bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087038592:0@lo:400:kworker.0 00000100:00100000:3.0:1787864988.669234:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864988.669261:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087039104:0@lo:400:kworker.0 00000100:00100000:3.0:1787864988.669282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864988.669306:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f709a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087038720:0@lo:400:kworker.0 00000100:00100000:3.0:1787864988.669323:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039104 00000100:00100000:3.0:1787864988.669326:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039104 00000100:00100000:3.0:1787864988.669355:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787864988.669361:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087039104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864988.669393:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087039104:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864988.669418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787864988.669434:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864988.669450:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087039104:0@lo:400:kworker.0 00000100:00100000:0.0:1787864988.669720:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087038592 00000100:00100000:0.0:1787864988.669725:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087038592 00000100:00100000:0.0:1787864988.669758:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787864988.669766:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864988.669801:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087038592:12345-0@lo:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864988.669807:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787864988.669928:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f70bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087038592:0@lo:400:kworker.0 00000100:00100000:1.0:1787864988.670001:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f708b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087038464:0@lo:400:kworker.0 00010000:00010000:2.0:1787864988.735235:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864988.833891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864988.833937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864988.833972:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864988.834242:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304064 00000100:00100000:3.0:1787864988.834254:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304064 00000100:00100000:3.0:1787864988.834321:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:3.0:1787864988.834331:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071304064:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864988.834442:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071304064:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 113us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864988.834450:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00080000:3.0:1787864988.834474:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864988.834573:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303808 00000100:00100000:2.0:1787864988.834578:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303808 00000100:00100000:2.0:1787864988.834621:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:2.0:1787864988.834629:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071303808:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864988.834664:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f708b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071303808:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864988.834672:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:1.0:1787864988.835297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864988.835334:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864988.835563:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303936 00000100:00100000:3.0:1787864988.835581:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303936 00000100:00100000:3.0:1787864988.835631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787864988.835639:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071303936:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864988.835682:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071303936:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864988.835689:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00080000:1.0:1787864988.836122:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864988.836423:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304192 00000100:00100000:2.0:1787864988.836429:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304192 00000100:00100000:2.0:1787864988.836472:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:2.0:1787864988.836481:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+6:2358:x1874712071304192:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864988.836539:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+6:2358:x1874712071304192:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 59us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864988.836546:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:0.0:1787864988.837628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071303680 00000100:00100000:0.0:1787864988.837636:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071303680 00000100:00100000:0.0:1787864988.837681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00100000:0.0:1787864988.837689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071303680:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787864988.837766:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071303680:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 77us (3793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864988.837774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00100000:3.0:1787864989.184307:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087039232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864989.184378:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864989.184478:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039232 00000100:00100000:3.0:1787864989.184486:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039232 00000100:00100000:3.0:1787864989.184542:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864989.184552:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087039232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864989.184584:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864989.193215:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087039232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8657us (8828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864989.193230:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787864989.198290:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087039232:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1787864989.213841:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787864989.213989:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787864989.214006:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1787864989.214085:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:2.0:1787864989.755708:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864990.779667:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864990.989853:0:12301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:09:50 (1787864990) 00000100:00100000:1.0:1787864991.739710:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087039360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864991.739783:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864991.739911:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039360 00000100:00100000:3.0:1787864991.739928:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039360 00000100:00100000:3.0:1787864991.739994:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787864991.740006:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087039360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864991.740045:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864991.740092:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087039360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864991.740099:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787864991.740221:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864991.740256:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087039360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864991.803849:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864992.231212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864992.232364:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304448 00000100:00100000:1.0:1787864992.232380:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304448 00000100:00100000:1.0:1787864992.232549:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:1.0:1787864992.233101:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+13:11289:x1874712071304448:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864992.233147:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864992.233176:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861922b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ad0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.233271:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.233288:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787864992.233671:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787864992.234694:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.235109:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.235125:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.235135:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240362:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240419:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240433:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864992.240447:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787864992.240700:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240708:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240715:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240722:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864992.240727:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240736:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240751:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20c8dc700) 00010000:00010000:1.0:1787864992.240755:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864992.240760:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240767:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861922b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240783:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240790:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240795:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240812:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864992.240815:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240821:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240830:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa211170500) 00010000:00010000:1.0:1787864992.240832:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864992.240835:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.240840:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.241334:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861922b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ad0 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.241351:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ad0 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864992.241359:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:1.0:1787864992.241362:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864992.241364:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a600, rc 0) 00000100:00100000:1.0:1787864992.246722:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11289:x1874712071304448:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 14144us (15504us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787864992.246738:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:1.0:1787864992.256146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864992.256323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304576 00000100:00100000:3.0:1787864992.256337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304576 00000100:00100000:3.0:1787864992.256437:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:3.0:1787864992.256450:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11289:x1874712071304576:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787864992.256611:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11289:x1874712071304576:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 164us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864992.256619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:3.0:1787864992.256692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864992.258715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304704 00000100:00100000:3.0:1787864992.258734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304704 00000100:00100000:3.0:1787864992.261365:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787864992.261383:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:2358:x1874712071304704:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864992.261425:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864992.261459:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ad0 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864992.261482:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:3.0:1787864992.261488:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864992.261586:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2358:x1874712071304704:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 207us (4893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864992.261593:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000040:00080000:2.0:1787864992.444737:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864992.444746:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787864992.444781:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787864992.444789:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787864992.831385:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864993.789431:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087039488:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.789462:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087039872:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.792947:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.793029:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864993.793040:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087040000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.793123:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087039616:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.793168:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087040128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793188:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.793207:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864993.793214:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087039744:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793237:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.793271:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039872 00000100:00100000:3.0:1787864993.793279:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039872 00000100:00100000:3.0:1787864993.793330:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087040128 00000100:00100000:3.0:1787864993.793333:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087040128 00000100:00100000:3.0:1787864993.793369:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787864993.793380:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793462:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087039872:12345-0@lo:400:kworker.0 Request processed in 84us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.793470:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787864993.793490:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864993.793507:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087040128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793545:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087040128:12345-0@lo:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.793552:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864993.793570:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087040000 00000100:00100000:3.0:1787864993.793574:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087040000 00000100:00100000:3.0:1787864993.793600:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039616 00000100:00100000:3.0:1787864993.793610:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039616 00000100:00100000:3.0:1787864993.793632:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039744 00000100:00100000:3.0:1787864993.793635:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039744 00000100:00100000:3.0:1787864993.793652:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787864993.793657:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087040000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793689:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087040000:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.793694:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787864993.793705:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787864993.793710:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087039616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.793734:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087039616:12345-0@lo:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.793740:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787864993.793753:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787864993.793759:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.795984:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087039744:12345-0@lo:400:kworker.0 Request processed in 2216us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.795997:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787864993.796048:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864993.796055:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864993.796058:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864993.796106:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087039744:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.796120:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087039616:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.796131:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087040128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.796170:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087040000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.796196:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087039872:0@lo:400:kworker.0 00000100:00100000:0.0:1787864993.798102:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864993.800153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087039488 00000100:00100000:3.0:1787864993.800167:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087039488 00000100:00100000:3.0:1787864993.800236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787864993.800246:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087039488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864993.800343:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087039488:12345-0@lo:400:kworker.0 Request processed in 99us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.800351:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787864993.800487:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087039488:0@lo:400:kworker.0 00010000:00010000:2.0:1787864993.855126:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864993.958314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864993.958391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864993.958452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864993.958474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864993.958509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864993.958666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304832 00000100:00100000:1.0:1787864993.958675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304832 00000100:00100000:1.0:1787864993.958761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 285 00000100:00100000:1.0:1787864993.958771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071304832:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864993.959106:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071304832:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 336us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864993.959115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 285 00000100:00100000:3.0:1787864993.961166:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305088 00000100:00100000:3.0:1787864993.961177:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305088 00000100:00100000:3.0:1787864993.961293:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305216 00000100:00100000:3.0:1787864993.961297:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305216 00000100:00100000:1.0:1787864993.961341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:1.0:1787864993.961352:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071305088:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864993.961447:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071305088:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 96us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864993.961454:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00080000:0.0:1787864993.961654:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864993.961658:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864993.962147:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:3.0:1787864993.962156:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071305216:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864993.962197:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2359:x1874712071305216:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (3687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864993.962203:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:3.0:1787864993.962222:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305344 00000100:00100000:3.0:1787864993.962227:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305344 00000100:00080000:0.0:1787864993.962284:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864993.962764:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071304960 00000100:00100000:3.0:1787864993.962768:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071304960 00000100:00100000:1.0:1787864993.962893:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:1.0:1787864993.962903:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2359:x1874712071305344:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864993.962938:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2359:x1874712071305344:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 38us (4487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864993.962944:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:1.0:1787864993.962958:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:1.0:1787864993.962964:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2359:x1874712071304960:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787864993.962989:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2359:x1874712071304960:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864993.962995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:1.0:1787864994.007993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.008078:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305472 00000100:00100000:3.0:1787864994.008087:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305472 00000100:00100000:3.0:1787864994.008158:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:3.0:1787864994.008170:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+14:11331:x1874712071305472:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864994.008188:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.008207:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861922d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ad7 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008279:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008292:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008303:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008318:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008324:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008330:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008609:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008617:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008623:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008628:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.008631:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008647:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008658:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:3.0:1787864994.008662:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.008666:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008672:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861922db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008684:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008690:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008696:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008701:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.008704:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008710:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008717:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864994.008719:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.008722:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008736:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008766:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861922d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ad7 expref: 15 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008775:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:3.0:1787864994.008777:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.008781:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861922d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ad7 expref: 15 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.008790:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350600, rc 0) 00000100:00100000:3.0:1787864994.008848:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+14:11331:x1874712071305472:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 681us (863us total) trans 0 rc 301/301 00000100:00100000:3.0:1787864994.008856:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00080000:0.0:1787864994.009014:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864994.020185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.020288:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305728 00000100:00100000:1.0:1787864994.020304:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305728 00000100:00100000:1.0:1787864994.020367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 140 00000100:00100000:1.0:1787864994.020376:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+14:11331:x1874712071305728:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:1.0:1787864994.020440:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864994.020465:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186191c52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7910 expref: 14 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.020484:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864994.020488:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864994.020767:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.020782:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 5 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.020790:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.020820:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 5 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.020942:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 5 pid: 8208 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.020957:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087040256:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864994.021050:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864994.042370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.042447:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087040256:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864994.042478:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864994.043108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305856 00000100:00100000:2.0:1787864994.043116:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305856 00010000:00010000:2.0:1787864994.043157:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 6 pid: 8208 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864994.043263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787864994.043274:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:259279c0-f351-4175-bf32-3107511ab0a0+6:2359:x1874712071305856:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864994.043611:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864994.043620:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 6 pid: 8208 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043633:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 6 pid: 8208 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043653:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe1861922aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac9 expref: 6 pid: 8208 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043681:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:2.0:1787864994.043686:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043694:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043701:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864994.043723:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864994.043773:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:2359:x1874712071305856:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 501us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864994.043780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00010000:00010000:1.0:1787864994.045476:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.045490:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.046941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.047493:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.047582:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864994.051904:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787864994.051920:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.051929:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.051937:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.051943:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.052285:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.052363:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.052389:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa211170800) 00010000:00010000:1.0:1787864994.052392:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.052425:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.052432:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861922e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864994.052451:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067c3c2df reply state 00000000bd2a22e7 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.052459:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864994.052558:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11331:x1874712071305728:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 32180us (32377us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787864994.052566:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 140 00010000:00010000:3.0:1787864994.061806:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.061821:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.062369:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.062379:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.062383:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.062390:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.062434:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa211170a00) 00010000:00010000:3.0:1787864994.062437:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.062442:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.062448:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861922f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864994.171939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.172084:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071305984 00000100:00100000:3.0:1787864994.172093:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071305984 00000100:00100000:3.0:1787864994.172385:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:3.0:1787864994.172437:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+14:11339:x1874712071305984:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:3.0:1787864994.172458:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.172489:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861922f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ade expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172560:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172573:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172585:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864994.172654:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787864994.172658:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864994.172687:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172727:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861922f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ade expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172746:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ade expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.172754:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787864994.172758:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864994.172761:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350000, rc 0) 00000100:00100000:3.0:1787864994.172827:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11339:x1874712071305984:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 433us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.172834:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:3.0:1787864994.242447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.242555:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071306112 00000100:00100000:1.0:1787864994.242565:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071306112 00000100:00100000:1.0:1787864994.242629:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:1.0:1787864994.242639:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+15:11345:x1874712071306112:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864994.242657:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.242677:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ae5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242737:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242751:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242779:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242794:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242801:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242807:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242928:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242935:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.242941:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864994.242979:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787864994.242982:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864994.243009:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243020:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243026:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243042:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243047:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.243051:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243058:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243069:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:1.0:1787864994.243072:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.243076:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243082:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe18619230c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243094:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243101:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243106:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243112:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.243114:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243129:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243137:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa211170800) 00010000:00010000:1.0:1787864994.243139:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.243142:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243148:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243176:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ae5 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243190:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ae5 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.243197:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864994.243199:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787864994.243201:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200030800, rc 0) 00000100:00100000:1.0:1787864994.243270:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+16:11345:x1874712071306112:12345-192.168.206.10@tcp:101:bash.0 Request processed in 633us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864994.243277:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:0.0:1787864994.258509:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.258606:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071306368 00000100:00100000:1.0:1787864994.258616:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071306368 00000100:00100000:1.0:1787864994.258691:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:1.0:1787864994.258701:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+16:11345:x1874712071306368:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864994.258924:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.258946:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186192321 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7aec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259079:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259093:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259104:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259138:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259146:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.259154:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787864994.260182:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787864994.261938:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.261959:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.261971:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262028:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262035:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262042:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262048:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.262052:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262060:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262072:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864994.262076:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.262081:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262087:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe186192328 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864994.262102:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038b23a78 reply state 0000000043c7b40f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.262112:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787864994.262150:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe186192321 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262179:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.262187:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864994.262189:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864994.262191:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a400, rc 0) 00000100:00100000:1.0:1787864994.262454:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11345:x1874712071306368:12345-192.168.206.10@tcp:101:bash.0 Request processed in 3752us (3963us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787864994.262463:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 143 00010000:00010000:1.0:1787864994.275136:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275153:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275161:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275168:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.275173:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275181:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275196:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa211170800) 00010000:00010000:1.0:1787864994.275200:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.275205:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.275224:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe18619232f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.277162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.277223:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071306496 00000100:00100000:1.0:1787864994.277232:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071306496 00000100:00100000:1.0:1787864994.277280:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:1.0:1787864994.277289:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071306496:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864994.277304:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.277322:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7af3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864994.277354:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787864994.277370:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1787864994.277374:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864994.277383:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.277434:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.277445:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b800, rc 0) 00000100:00100000:1.0:1787864994.277511:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071306496:12345-192.168.206.10@tcp:101:bash.0 Request processed in 222us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864994.277517:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787864994.282751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.282943:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071306624 00000100:00100000:1.0:1787864994.282952:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071306624 00000100:00100000:1.0:1787864994.283018:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787864994.283028:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:11345:x1874712071306624:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864994.283045:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.283061:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7afa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.283092:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.283102:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864994.283106:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864994.283112:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.283146:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.283158:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 7 pid: 6695 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.283171:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087040384:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864994.283254:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b446e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864994.291957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.293589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071306752 00000100:00100000:3.0:1787864994.293600:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071306752 00010000:00010000:3.0:1787864994.293644:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 8 pid: 6695 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864994.293775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787864994.293787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071306752:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864994.293801:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864994.293822:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 8 pid: 6695 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.293836:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 8 pid: 6695 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.293872:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864994.293877:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864994.293886:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.293896:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.293938:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864994.293954:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874712087040512:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787864994.294118:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b304a80 going to sleep for 11 seconds 00010000:00010000:1.0:1787864994.295293:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135a931b/0xa63eebe186192344 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7af3 expref: 8 pid: 6695 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.295315:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087040384:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864994.295352:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.295365:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a600, rc 0) 00000100:00100000:1.0:1787864994.295445:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:11345:x1874712071306624:12345-192.168.206.10@tcp:101:bash.0 Request processed in 12417us (12703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864994.295454:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787864994.297211:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874712087040512:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787864994.297232:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864994.297279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071306752:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 3494us (5330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.297288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787864994.306364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864994.306414:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307008 00000100:00100000:2.0:1787864994.306423:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307008 00000100:00100000:2.0:1787864994.306472:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787864994.306483:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11345:x1874712071307008:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787864994.308247:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11345:x1874712071307008:12345-192.168.206.10@tcp:35:bash.0 Request processed in 1746us (1871us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787864994.308260:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787864994.311107:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087040640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864994.311174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864994.311230:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087040640 00000100:00100000:3.0:1787864994.311236:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087040640 00000100:00100000:3.0:1787864994.311279:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787864994.311288:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087040640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864994.311334:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787864994.311375:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087040640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.311382:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787864994.311797:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087040640:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787864994.356389:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:2.0:1787864994.382137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.382254:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307264 00000100:00100000:3.0:1787864994.382264:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307264 00000100:00100000:3.0:1787864994.382326:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:3.0:1787864994.382336:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+16:11355:x1874712071307264:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864994.382359:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.382380:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b01 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864994.383203:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787864994.383415:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192352 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b01 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.383430:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864994.383434:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864994.383439:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b01 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.383454:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350600, rc 0) 00000100:00100000:0.0:1787864994.383529:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:11355:x1874712071307264:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1194us (1403us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787864994.383536:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:2.0:1787864994.387651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864994.387795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307520 00000100:00100000:0.0:1787864994.387804:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307520 00000100:00100000:0.0:1787864994.387869:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787864994.387880:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+17:11355:x1874712071307520:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787864994.388318:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11355:x1874712071307520:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 438us (674us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787864994.388326:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:2.0:1787864994.467573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864994.467634:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.467783:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307776 00000100:00100000:1.0:1787864994.467794:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307776 00000100:00100000:1.0:1787864994.467853:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:1.0:1787864994.467864:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071307776:12345-192.168.206.10@tcp:16:kworker.0 00000100:00100000:1.0:1787864994.467984:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071307776:12345-192.168.206.10@tcp:16:kworker.0 Request processed in 123us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864994.467992:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787864994.468064:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307648 00000100:00100000:0.0:1787864994.468075:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307648 00002000:00100000:0.0:1787864994.468100:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa22ea3a940 x1874712071307648/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:90/0 lens 504/0 e 0 to 0 dl 1787865005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864994.468110:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22ea3a940 with x1874712071307648 ext(0->12) 00002000:00010000:0.0:1787864994.468115:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa22ea3a940 00000100:00100000:0.0:1787864994.468139:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787864994.468147:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2357:x1874712071307648:12345-192.168.206.10@tcp:4:bash.0 00000100:00100000:0.0:1787864994.468647:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2357:x1874712071307648:12345-192.168.206.10@tcp:4:bash.0 Request processed in 499us (1011us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787864994.468655:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00002000:00100000:0.0:1787864994.468661:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa22ea3a940 x1874712071307648/t4294967305(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:90/0 lens 504/448 e 0 to 0 dl 1787865005 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864994.468670:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22ea3a940 with x1874712071307648 ext(0->12) 00002000:00010000:0.0:1787864994.468674:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa22ea3a940 00000100:00100000:2.0:1787864994.477934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.478167:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071307904 00000100:00100000:3.0:1787864994.478177:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071307904 00000100:00100000:3.0:1787864994.478237:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:3.0:1787864994.478247:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11361:x1874712071307904:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864994.478268:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.478289:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b08 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.478350:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.478363:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.478899:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864994.479092:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787864994.479096:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864994.479168:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.479200:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b08 expref: 20 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.479219:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b08 expref: 19 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.479228:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864994.479231:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864994.479235:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787864994.479392:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11361:x1874712071307904:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1145us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.479435:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:2.0:1787864994.491486:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.491583:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071308160 00000100:00100000:1.0:1787864994.491592:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071308160 00000100:00100000:1.0:1787864994.491646:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:1.0:1787864994.491657:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11361:x1874712071308160:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864994.491677:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.491697:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619236e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b0f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.491789:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.491802:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.491826:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864994.491850:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787864994.491973:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619236e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b0f expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.491990:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b0f expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.492007:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864994.492010:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864994.492014:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa200031600, rc 0) 00000100:00100000:1.0:1787864994.492072:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+21:11361:x1874712071308160:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 417us (595us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787864994.492078:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:1.0:1787864994.504629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.504780:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071308416 00000100:00100000:3.0:1787864994.504790:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071308416 00000100:00100000:3.0:1787864994.504855:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:3.0:1787864994.504865:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+21:11361:x1874712071308416:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864994.504888:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.504907:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192383 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.504996:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.505046:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.505058:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864994.505072:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787864994.505186:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192383 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b16 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.505206:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b16 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.505215:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:3.0:1787864994.505218:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787864994.505222:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351600, rc 0) 00000100:00100000:3.0:1787864994.505285:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+23:11361:x1874712071308416:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 422us (666us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787864994.505293:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:2.0:1787864994.506789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864994.506874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071308544 00000100:00100000:0.0:1787864994.506881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071308544 00000100:00100000:0.0:1787864994.506936:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787864994.506947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+23:2356:x1874712071308544:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864994.506959:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864994.506980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe186192375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b0f expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.507007:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:0.0:1787864994.507307:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864994.507359:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:2356:x1874712071308544:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 413us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864994.507387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787864994.514799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.514927:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071308672 00000100:00100000:3.0:1787864994.514936:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071308672 00000100:00100000:3.0:1787864994.514993:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787864994.515003:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071308672:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:3.0:1787864994.515159:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.515181:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.515202:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864994.515206:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864994.515210:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.515243:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.515256:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 8 pid: 6696 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864994.515269:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874712087040768:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864994.515688:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b304a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864994.518965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.519078:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874712087040768:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864994.519104:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.520976:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071308800 00000100:00100000:0.0:1787864994.520989:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071308800 00010000:00010000:0.0:1787864994.521654:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 9 pid: 6696 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.521752:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787864994.521765:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071308800:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864994.521779:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787864994.521797:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787864994.521801:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787864994 00002000:00010000:0.0:1787864994.521804:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787864994 00010000:00010000:0.0:1787864994.521810:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 9 pid: 6696 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.521824:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 9 pid: 6696 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.521859:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1af5c1d/0xa63eebe18619234b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7afa expref: 9 pid: 6696 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.521878:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864994.521883:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864994.521889:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.521916:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.521955:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864994.522026:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071308800:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 264us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864994.522034:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00010000:00010000:1.0:1787864994.522091:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522101:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522125:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522146:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522155:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522163:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864994.522167:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522176:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522188:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.522196:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009282f08e/0xa63eebe186192398 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.522244:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071308672:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 7243us (7453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864994.522253:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:2.0:1787864994.535308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864994.538571:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309056 00000100:00100000:0.0:1787864994.538583:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309056 00000100:00100000:0.0:1787864994.538647:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:0.0:1787864994.538657:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:11361:x1874712071309056:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:0.0:1787864994.538712:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b16 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864994.538949:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787864994.538991:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787864994.539646:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787864994.539701:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.539717:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.539726:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.539755:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.539776:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 26 pid: 5849 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.539791:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087040896:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864994.539870:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864994.543816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.544519:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309184 00000100:00100000:3.0:1787864994.544528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309184 00010000:00010000:3.0:1787864994.544576:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 27 pid: 5849 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864994.544618:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787864994.544628:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+27:2358:x1874712071309184:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864994.544656:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864994.544661:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 27 pid: 5849 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.544674:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 27 pid: 5849 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.544694:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:3.0:1787864994.544699:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.544708:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.544715:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.544731:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864994.544789:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+27:2358:x1874712071309184:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 162us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.544797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00010000:00010000:0.0:1787864994.546686:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe186192336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aec expref: 26 pid: 5849 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.546708:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1874712087040896:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787864994.546729:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.546738:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.546743:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864994.548336:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787864994.548617:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787864994.548714:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087041024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864994.548772:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864994.548795:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864994.549202:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087041024 00000100:00100000:2.0:1787864994.549210:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087041024 00000100:00100000:2.0:1787864994.549261:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864994.549269:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087041024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864994.549356:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087041024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864994.549364:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864994.549447:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087041024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787864994.549859:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787864994.549916:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087041152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787864994.549947:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864994.549972:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2084aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864994.550238:0:11973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087041152 00000100:00100000:2.0:1787864994.550243:0:11973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087041152 00000100:00100000:2.0:1787864994.550277:0:11973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864994.550292:0:11973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5852:x1874712087041152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864994.550448:0:11973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5852:x1874712087041152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 157us (500us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787864994.550455:0:11973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864994.552765:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1874712087041152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787864994.552880:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787864994.552939:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.552949:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.552955:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.552961:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.552965:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.552972:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.552987:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864994.552990:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787864994.552994:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.553000:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492e00/0xa63eebe18619239f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787864994.560630:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787864994.560768:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787864994.560794:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310500396927ns, next at 311500394117ns, rc = 0 00000001:00080000:1.0:1787864994.560804:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787864994.561693:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864994.561701:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787864994.561714:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619238a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b16 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864994.562167:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+29:11361:x1874712071309056:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 23507us (26876us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787864994.562177:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000020:00080000:1.0:1787864994.562183:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787864994.576194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.580520:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309312 00000100:00100000:3.0:1787864994.580535:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309312 00000100:00100000:3.0:1787864994.580711:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:3.0:1787864994.580720:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+29:11361:x1874712071309312:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864994.580743:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864994.580768:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861923a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b1d expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.580845:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861923a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b1d expref: 30 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.580859:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861923a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b1d expref: 30 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.580877:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864994.580881:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864994.580884:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864994.580958:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+30:11361:x1874712071309312:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 238us (4775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.580966:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:2.0:1787864994.591200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.591357:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309568 00000100:00100000:3.0:1787864994.591366:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309568 00000100:00100000:3.0:1787864994.592045:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787864994.592056:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+30:11361:x1874712071309568:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864994.592389:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+31:11361:x1874712071309568:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 333us (1196us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787864994.592415:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787864994.682244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864994.682750:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309824 00000100:00100000:0.0:1787864994.682760:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309824 00000100:00100000:0.0:1787864994.682822:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:0.0:1787864994.682841:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+31:11371:x1874712071309824:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864994.682880:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864994.682901:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b24 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864994.683259:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787864994.683950:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b24 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.683969:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:0.0:1787864994.683973:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864994.683978:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b24 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.683992:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493800, rc 0) 00000100:00100000:0.0:1787864994.684177:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11371:x1874712071309824:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1337us (1942us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787864994.684186:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:2.0:1787864994.692876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.693006:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071309952 00000100:00100000:3.0:1787864994.693015:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071309952 00000100:00100000:3.0:1787864994.693138:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:3.0:1787864994.693148:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11371:x1874712071309952:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787864994.693221:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.693255:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.693267:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.694164:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.694182:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.694192:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.695937:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.695956:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.695967:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864994.696016:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696134:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696144:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696168:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696174:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.696178:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696186:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696198:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864994.696201:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.696206:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696212:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861923bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696229:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696235:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696241:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696247:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.696249:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696264:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.696273:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc500) 00010000:00010000:3.0:1787864994.696275:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.696279:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697915:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861923c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697955:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697963:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697971:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697976:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864994.697980:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.697988:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.698001:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864994.698004:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864994.698008:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864994.698031:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864994.698795:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11371:x1874712071309952:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 5642us (5921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864994.698807:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:2.0:1787864994.703993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.704731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071310208 00000100:00100000:3.0:1787864994.704743:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071310208 00000100:00100000:3.0:1787864994.704804:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:3.0:1787864994.704814:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11371:x1874712071310208:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864994.705271:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:11371:x1874712071310208:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 456us (1284us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787864994.705279:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787864994.773937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864994.774570:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071310464 00000100:00100000:1.0:1787864994.774581:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071310464 00000100:00100000:1.0:1787864994.774647:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:1.0:1787864994.774658:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+33:11374:x1874712071310464:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864994.774682:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864994.774703:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861923d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b2b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774779:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774794:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774804:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774819:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774961:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.774967:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775346:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775356:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775364:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864994.775374:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787864994.775655:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775662:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775668:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775673:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.775677:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775685:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775709:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864994.775712:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.775716:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775722:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031400/0xa63eebe1861923d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775733:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775738:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775743:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775748:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864994.775751:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775756:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775762:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa211170900) 00010000:00010000:1.0:1787864994.775764:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864994.775767:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775772:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031a00/0xa63eebe1861923de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775952:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031600/0xa63eebe1861923d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775969:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864994.775976:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864994.775978:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864994.775980:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a400, rc 0) 00000100:00100000:1.0:1787864994.776106:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11374:x1874712071310464:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1449us (2177us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787864994.776114:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:2.0:1787864994.782270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864994.784628:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071310592 00000100:00100000:0.0:1787864994.784642:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071310592 00000100:00100000:0.0:1787864994.784717:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:0.0:1787864994.784728:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11374:x1874712071310592:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787864994.784795:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784813:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784837:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784877:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784883:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784890:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784896:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864994.784900:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784907:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784919:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864994.784922:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864994.784926:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864994.784939:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493800/0xa63eebe1861923f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864994.785029:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11374:x1874712071310592:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 301us (2766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864994.785048:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:2.0:1787864994.791095:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864994.791235:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071310848 00000100:00100000:3.0:1787864994.791245:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071310848 00000100:00100000:3.0:1787864994.791306:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:3.0:1787864994.791316:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11374:x1874712071310848:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787864994.792161:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+36:11374:x1874712071310848:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 842us (1070us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787864994.792170:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00010000:00010000:1.0:1787864994.876559:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787864994.937077:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787864994.937108:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1787864995.058913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.059085:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071311104 00000100:00100000:3.0:1787864995.059094:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071311104 00000100:00100000:3.0:1787864995.059158:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:3.0:1787864995.059170:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+36:11405:x1874712071311104:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787864995.059205:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864995.059235:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b32 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.059333:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.059346:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.059356:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864995.059367:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787864995.059531:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861923fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b32 expref: 39 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.059550:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b32 expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.059558:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.059561:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864995.059564:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864995.059622:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11405:x1874712071311104:12345-192.168.206.10@tcp:101:cat.0 Request processed in 455us (718us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787864995.059629:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:2.0:1787864995.065075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864995.065122:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864995.065294:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071311360 00000100:00100000:0.0:1787864995.065304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071311360 00000100:00100000:0.0:1787864995.065360:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787864995.065381:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11405:x1874712071311360:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787864995.065679:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+39:11405:x1874712071311360:12345-192.168.206.10@tcp:35:cat.0 Request processed in 299us (621us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787864995.065687:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787864995.065861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071311488 00000100:00100000:3.0:1787864995.065867:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071311488 00000100:00100000:3.0:1787864995.066098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787864995.066107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+39:2357:x1874712071311488:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864995.066127:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864995.066149:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b32 expref: 39 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.066167:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.066172:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864995.066214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+38:2357:x1874712071311488:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 109us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864995.066221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787864995.126127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864995.126291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071311744 00000100:00100000:1.0:1787864995.126300:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071311744 00000100:00100000:1.0:1787864995.126360:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:1.0:1787864995.126370:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11411:x1874712071311744:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787864995.126429:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864995.126432:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787864995.126458:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b08 expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126479:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864995.126512:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864995.126529:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619240f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126619:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126633:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126641:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126674:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.126688:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 38 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864995.126700:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087041280:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864995.126786:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2084aae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864995.131531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864995.131625:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087041280:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864995.131662:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.131746:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071311872 00000100:00100000:0.0:1787864995.131752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071311872 00010000:00010000:0.0:1787864995.131789:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 39 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.131829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787864995.131839:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+39:2358:x1874712071311872:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864995.131854:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864995.131861:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 39 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131873:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 39 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131897:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861923e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b2b expref: 39 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131913:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864995.131918:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131927:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.131976:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864995.132034:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+38:2358:x1874712071311872:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 196us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864995.132042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00010000:00010000:1.0:1787864995.132260:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.132269:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864995.132297:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787864995.132505:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619240f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.132525:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.132534:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864995.132538:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864995.132541:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a600, rc 0) 00000100:00100000:1.0:1787864995.132590:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11411:x1874712071311744:12345-192.168.206.10@tcp:101:dd.0 Request processed in 6221us (6474us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787864995.132601:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:2.0:1787864995.134038:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864995.134094:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071312128 00000100:00100000:0.0:1787864995.134104:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071312128 00000100:00100000:0.0:1787864995.134222:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 155 00000100:00100000:0.0:1787864995.134234:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11411:x1874712071312128:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:0.0:1787864995.134597:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.134619:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.134632:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864995.134699:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787864995.134728:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce704ba7 reply state 00000000e4900bc8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.134739:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864995.134865:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+41:11411:x1874712071312128:12345-192.168.206.10@tcp:36:dd.0 Request processed in 632us (838us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787864995.134873:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 155 00000020:00080000:0.0:1787864995.134879:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787864995.136462:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136482:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136502:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136511:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864995.136516:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136525:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136546:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.136549:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864995.136556:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.136581:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192424 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864995.305757:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.306120:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071312256 00000100:00100000:3.0:1787864995.306129:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071312256 00000100:00100000:3.0:1787864995.306205:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:3.0:1787864995.306215:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+40:11425:x1874712071312256:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787864995.306239:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864995.306259:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619242b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b40 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306332:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306346:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306356:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306370:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306375:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306381:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306702:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306721:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306734:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306767:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.306780:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 41 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864995.306793:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087041408:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864995.306907:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864995.317356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.317505:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087041408:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864995.317534:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864995.318071:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071312512 00000100:00100000:1.0:1787864995.318087:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071312512 00000100:00100000:1.0:1787864995.318634:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787864995.318649:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+42:9949:x1874712071312512:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787864995.319114:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+43:9949:x1874712071312512:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 467us (1763us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787864995.319123:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787864995.328233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.328312:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071312640 00000100:00100000:3.0:1787864995.328324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071312640 00010000:00010000:3.0:1787864995.328362:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 43 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864995.328424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787864995.328432:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+43:2358:x1874712071312640:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864995.328443:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864995.328459:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 43 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328468:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 43 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328485:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192416 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b39 expref: 43 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328511:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.328517:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328526:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328533:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.328730:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864995.328793:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+42:2358:x1874712071312640:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 360us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864995.328800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00010000:00010000:2.0:1787864995.329306:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329314:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864995.329351:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787864995.329354:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864995.329373:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329383:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329390:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329394:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329420:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329426:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864995.329430:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329447:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329459:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864995.329462:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864995.329465:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329471:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329485:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329513:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329520:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329525:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864995.329529:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329538:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329547:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc500) 00010000:00010000:2.0:1787864995.329549:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864995.329552:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329568:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329605:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619242b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b40 expref: 42 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329618:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b40 expref: 41 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.329626:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:2.0:1787864995.329628:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864995.329630:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00000100:00100000:2.0:1787864995.329675:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+41:11425:x1874712071312256:12345-192.168.206.10@tcp:101:stat.0 Request processed in 23461us (23926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864995.329682:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:0.0:1787864995.437436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864995.437537:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071312896 00000100:00100000:1.0:1787864995.437557:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071312896 00000100:00100000:1.0:1787864995.437618:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 157 00000100:00100000:1.0:1787864995.437630:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+41:11431:x1874712071312896:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:1.0:1787864995.437689:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864995.437727:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b40 expref: 41 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.437747:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864995.437752:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864995.437965:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.437980:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.437990:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864995.438044:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787864995.438071:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006413724 reply state 000000003b5645a6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864995.438080:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864995.438192:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+43:11431:x1874712071312896:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 564us (800us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787864995.438199:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 157 00000020:00080000:1.0:1787864995.438204:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787864995.442136:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442151:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442159:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442182:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864995.442188:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442197:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442224:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864995.442228:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864995.442233:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.442239:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192447 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.599719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.599957:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071313024 00000100:00100000:3.0:1787864995.599966:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071313024 00000100:00100000:3.0:1787864995.600082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:3.0:1787864995.600093:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+42:11445:x1874712071313024:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787864995.600117:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864995.600136:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe18619244e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b47 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600207:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600233:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600244:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600258:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600265:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600270:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600694:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600704:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600713:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864995.600744:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787864995.600748:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864995.600768:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600789:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600797:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600804:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600811:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600817:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864995.600888:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600897:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600909:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864995.600912:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864995.600917:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600923:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600936:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600943:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600954:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600959:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864995.600962:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600968:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600975:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864995.600977:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864995.600980:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.600985:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619245c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.601017:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe18619244e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.601030:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.601037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.601039:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864995.601041:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864995.601105:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+43:11445:x1874712071313024:12345-192.168.206.10@tcp:101:stat.0 Request processed in 1014us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864995.601121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:3.0:1787864995.726181:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864995.726289:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071313280 00000100:00100000:2.0:1787864995.726298:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071313280 00000100:00100000:2.0:1787864995.726355:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:2.0:1787864995.726364:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+43:11455:x1874712071313280:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787864995.726419:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864995.726448:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe18619246a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b4e expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864995.726962:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787864995.727117:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe18619246a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b4e expref: 45 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.727146:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787864995.727149:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864995.727155:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe18619246a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b4e expref: 45 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.727168:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581a00, rc 0) 00000100:00100000:2.0:1787864995.727234:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+44:11455:x1874712071313280:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 871us (1061us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787864995.727241:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:0.0:1787864995.734207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864995.734299:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071313536 00000100:00100000:2.0:1787864995.734309:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071313536 00000100:00100000:2.0:1787864995.734552:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787864995.734566:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+44:11455:x1874712071313536:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864995.735360:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+45:11455:x1874712071313536:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 794us (1159us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787864995.735718:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787864995.852903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864995.853339:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071313792 00000100:00100000:3.0:1787864995.853351:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071313792 00000100:00100000:3.0:1787864995.853439:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:3.0:1787864995.853451:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+45:11461:x1874712071313792:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864995.853473:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864995.853503:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192478 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.853751:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.853765:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.853774:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.853807:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.854006:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 46 pid: 5850 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864995.854021:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa107e1fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087041536:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864995.855158:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864995.864018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864995.864302:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071313920 00000100:00100000:0.0:1787864995.864312:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071313920 00010000:00010000:0.0:1787864995.864356:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 47 pid: 5850 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.864430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787864995.864440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+47:2358:x1874712071313920:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864995.864673:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864995.864749:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 47 pid: 5850 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.864763:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 47 pid: 5850 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.864788:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864995.864793:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.864802:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.864808:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.864915:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864995.864971:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+47:2358:x1874712071313920:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 533us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864995.864979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00010000:00010000:1.0:1787864995.865800:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b47 expref: 46 pid: 5850 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864995.865897:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa107e1fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087041536:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864995.865921:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.865930:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.865935:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864995.865954:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787864995.866378:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192478 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.866796:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864995.866805:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864995.866808:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864995.866811:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:1.0:1787864995.867121:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+46:11461:x1874712071313792:12345-192.168.206.10@tcp:101:bash.0 Request processed in 13672us (14226us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787864995.867130:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:3.0:1787864995.880285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864995.885168:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071314176 00000100:00100000:0.0:1787864995.885184:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071314176 00000100:00100000:0.0:1787864995.885263:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 161 00000100:00100000:0.0:1787864995.885274:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+46:11461:x1874712071314176:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787864995.885975:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.885994:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.886006:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864995.886059:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787864995.886086:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000882faf88 reply state 000000001408e2b4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.886094:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864995.886194:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+49:11461:x1874712071314176:12345-192.168.206.10@tcp:36:bash.0 Request processed in 921us (5919us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787864995.886202:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 161 00000020:00080000:0.0:1787864995.886207:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787864995.890435:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891170:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891178:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891184:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864995.891188:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891196:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891212:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864995.891216:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864995.891221:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.891228:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe18619248d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864995.893354:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864995.893552:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071314304 00000100:00100000:2.0:1787864995.893562:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071314304 00000100:00100000:2.0:1787864995.893615:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:2.0:1787864995.893625:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+48:11461:x1874712071314304:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787864995.893650:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864995.893670:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b5c expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.893767:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.893795:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.893803:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.893847:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.893860:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 49 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864995.893872:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea38b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087041664:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864995.893954:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864995.898729:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea38b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087041664:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864995.898756:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864995.899535:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864995.900934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864995.910047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071314432 00000100:00100000:0.0:1787864995.910062:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071314432 00010000:00010000:0.0:1787864995.910110:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 50 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864995.910228:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:0.0:1787864995.910240:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:2358:x1874712071314432:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864995.910255:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864995.910262:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 50 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910287:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 50 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910311:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619247f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b55 expref: 50 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910330:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864995.910335:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910345:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910353:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864995.910384:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864995.910501:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+49:2358:x1874712071314432:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 263us (9574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864995.910524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00010000:00010000:2.0:1787864995.910596:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.910606:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864995.910650:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787864995.910655:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864995.910676:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.910732:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b5c expref: 49 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.910748:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b5c expref: 48 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864995.910756:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:2.0:1787864995.910759:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864995.910762:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580e00, rc 0) 00000100:00100000:2.0:1787864995.910787:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+48:11461:x1874712071314304:12345-192.168.206.10@tcp:101:bash.0 Request processed in 17164us (17443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864995.910795:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:0.0:1787864995.925875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864995.926072:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071314688 00000100:00100000:1.0:1787864995.926081:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071314688 00000100:00100000:1.0:1787864995.926134:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787864995.926144:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+48:11461:x1874712071314688:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787864995.926453:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+49:11461:x1874712071314688:12345-192.168.206.10@tcp:35:bash.0 Request processed in 235us (515us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787864995.926462:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787864996.126805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.126996:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071314944 00000100:00100000:1.0:1787864996.127005:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071314944 00000100:00100000:1.0:1787864996.127124:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:1.0:1787864996.127134:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+49:11472:x1874712071314944:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864996.127155:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864996.127174:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861924a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b63 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864996.127466:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787864996.127748:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861924a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b63 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.127763:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:1.0:1787864996.127766:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864996.127771:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861924a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b63 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.127784:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a600, rc 0) 00000100:00100000:1.0:1787864996.127918:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11472:x1874712071314944:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 785us (1121us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787864996.127925:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00080000:0.0:1787864996.128244:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864996.137136:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.137250:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071315072 00000100:00100000:0.0:1787864996.137259:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071315072 00000100:00100000:0.0:1787864996.137314:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:0.0:1787864996.137324:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11472:x1874712071315072:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787864996.137421:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137438:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137452:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137468:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137475:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137481:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137777:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137786:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137793:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864996.137832:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137853:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137859:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137866:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137872:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864996.137876:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137884:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137896:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:0.0:1787864996.137898:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864996.137903:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137909:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492400/0xa63eebe1861924b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137921:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137927:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137933:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137943:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864996.137946:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137953:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137961:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20378b700) 00010000:00010000:0.0:1787864996.137963:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864996.137965:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137971:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe1861924b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137984:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137990:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137995:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.137999:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864996.138002:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.138008:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.138023:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864996.138026:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864996.138028:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.138034:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861924be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864996.138122:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11472:x1874712071315072:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 799us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.138130:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:3.0:1787864996.140836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.141144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071315328 00000100:00100000:1.0:1787864996.141152:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071315328 00000100:00100000:1.0:1787864996.141207:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787864996.141215:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11472:x1874712071315328:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864996.141871:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+51:11472:x1874712071315328:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 653us (1040us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787864996.141879:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:2.0:1787864996.206849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.206982:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071315584 00000100:00100000:3.0:1787864996.207003:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071315584 00000100:00100000:3.0:1787864996.207076:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:3.0:1787864996.207085:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+51:11475:x1874712071315584:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864996.207107:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.207127:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861924c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b6a expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207195:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207207:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207218:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207231:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207238:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207244:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207587:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861924da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207597:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861924da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207604:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861924da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864996.207622:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787864996.207707:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207714:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207720:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207726:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.207730:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207737:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207748:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864996.207752:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864996.207756:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207762:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861924cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207775:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207781:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207795:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207800:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.207803:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207809:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207829:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864996.207831:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864996.207835:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207840:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207879:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861924c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b6a expref: 54 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207893:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861924da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b6a expref: 53 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.207900:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864996.207903:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864996.207905:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864996.207973:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+53:11475:x1874712071315584:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 889us (1131us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787864996.207988:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:3.0:1787864996.220224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.220268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.220355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071315840 00000100:00100000:0.0:1787864996.220364:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071315840 00000100:00100000:0.0:1787864996.220470:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787864996.220480:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+53:2356:x1874712071315840:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864996.220504:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864996.220526:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861924da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b6a expref: 53 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.220556:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:0.0:1787864996.220561:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864996.220608:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:2356:x1874712071315840:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.220616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787864996.221072:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071315712 00000100:00100000:2.0:1787864996.221077:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071315712 00000100:00100000:2.0:1787864996.221115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:2.0:1787864996.221123:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11475:x1874712071315712:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787864996.221177:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221192:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221202:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221224:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221242:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221247:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221252:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.221256:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221263:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221271:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:2.0:1787864996.221274:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864996.221277:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.221282:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe1861924e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.221323:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11475:x1874712071315712:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 200us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.221330:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:0.0:1787864996.226730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.226886:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071316096 00000100:00100000:2.0:1787864996.226896:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071316096 00000100:00100000:2.0:1787864996.226987:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787864996.226996:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11475:x1874712071316096:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787864996.227224:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+53:11475:x1874712071316096:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 219us (491us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787864996.227244:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787864996.412736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.412920:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071316352 00000100:00100000:3.0:1787864996.412930:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071316352 00000100:00100000:3.0:1787864996.412997:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:3.0:1787864996.413008:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+53:11493:x1874712071316352:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787864996.413035:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.413055:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861924ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b71 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.413147:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.413162:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.413173:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864996.413184:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787864996.413300:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861924ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b71 expref: 56 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.413318:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b71 expref: 55 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.413326:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:3.0:1787864996.413339:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787864996.413343:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787864996.413553:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11493:x1874712071316352:12345-192.168.206.10@tcp:101:cat.0 Request processed in 546us (825us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787864996.413560:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:3.0:1787864996.441986:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.442212:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071316480 00000100:00100000:1.0:1787864996.442222:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071316480 00000100:00100000:1.0:1787864996.442280:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:1.0:1787864996.442290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11494:x1874712071316480:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864996.442311:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864996.442331:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.442455:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.442468:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.442479:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864996.442784:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787864996.442789:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864996.443274:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.443307:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b78 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.443326:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b78 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.443334:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864996.443338:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864996.443341:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b800, rc 0) 00000100:00100000:1.0:1787864996.443585:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11494:x1874712071316480:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1295us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.443593:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:0.0:1787864996.455800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.456157:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071316864 00000100:00100000:1.0:1787864996.456166:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071316864 00000100:00100000:1.0:1787864996.456234:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787864996.456243:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11494:x1874712071316864:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864996.456589:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11494:x1874712071316864:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 345us (796us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787864996.456596:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787864996.463788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.463881:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071316992 00000100:00100000:1.0:1787864996.463889:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071316992 00000100:00100000:1.0:1787864996.463953:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787864996.463963:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11494:x1874712071316992:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:1.0:1787864996.464125:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787864996.464152:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe18619249b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b5c expref: 57 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.464175:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe1861924f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b71 expref: 56 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.464189:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861923a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b1d expref: 55 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.464200:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc200) 00010000:00010000:1.0:1787864996.464210:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864996.464264:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11494:x1874712071316992:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 303us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.464272:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787864996.467723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.467803:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317120 00000100:00100000:0.0:1787864996.467833:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317120 00000100:00100000:0.0:1787864996.467882:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:0.0:1787864996.467892:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11494:x1874712071317120:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:0.0:1787864996.468008:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.468024:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.468035:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864996.468214:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787864996.468289:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11494:x1874712071317120:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 398us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.468298:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:0.0:1787864996.486722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.486806:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317248 00000100:00100000:3.0:1787864996.486816:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317248 00000100:00100000:3.0:1787864996.486933:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:3.0:1787864996.486944:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11496:x1874712071317248:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864996.486964:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.486983:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b7f expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487046:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487060:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487071:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487084:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487091:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.487097:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488116:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488129:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488137:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864996.488173:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787864996.488177:0:10329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864996.488194:0:10329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488207:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488215:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488222:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488229:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488235:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.488239:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488246:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488268:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864996.488270:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864996.488422:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488430:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488446:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488453:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488459:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488464:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.488467:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488473:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488492:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864996.488495:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864996.488498:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488504:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488554:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 56 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488569:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 55 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.488576:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:3.0:1787864996.488578:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864996.488580:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864996.488714:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11496:x1874712071317248:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1771us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864996.488722:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 170 00000040:00080000:3.0:1787864996.540580:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864996.540589:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864996.540654:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787864996.540661:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864996.540779:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa210d4da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087041792:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864996.540876:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864996.543460:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa210d4da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087041792:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864996.546515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.546646:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317376 00000100:00100000:1.0:1787864996.546656:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317376 00000100:00100000:1.0:1787864996.546715:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:1.0:1787864996.546732:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11507:x1874712071317376:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787864996.546762:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787864996.546879:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11507:x1874712071317376:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 148us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.546887:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:0.0:1787864996.550550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.551275:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317504 00000100:00100000:2.0:1787864996.551285:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317504 00000100:00100000:2.0:1787864996.551348:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:2.0:1787864996.551359:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11507:x1874712071317504:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.551457:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551473:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551496:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551553:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551561:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551567:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551595:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551623:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551631:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864996.551668:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787864996.551672:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864996.551684:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551695:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551702:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551709:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551715:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.551719:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551726:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551738:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:2.0:1787864996.551741:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.551746:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551764:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192535 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551778:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551784:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551789:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551794:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.551797:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551803:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551811:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fa206f51000) 00010000:00010000:2.0:1787864996.551814:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.551816:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551821:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619253c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551835:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551841:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551854:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551858:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.551861:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551866:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551874:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:2.0:1787864996.551876:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.551878:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.551884:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.551969:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b822940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11507:x1874712071317504:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 611us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.551978:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:2.0:1787864996.558848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.558938:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317760 00000100:00100000:3.0:1787864996.558947:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317760 00000100:00100000:3.0:1787864996.559011:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:3.0:1787864996.559021:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11507:x1874712071317760:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864996.559039:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.559058:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619254a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b86 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559169:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559183:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559194:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864996.559206:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787864996.559334:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559342:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559348:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559354:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.559359:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559366:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559379:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:3.0:1787864996.559382:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864996.559387:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559434:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe186192551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559474:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619254a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b86 expref: 57 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559494:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:3.0:1787864996.559497:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864996.559501:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619254a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b86 expref: 57 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.559512:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00000100:00100000:3.0:1787864996.559576:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071317760:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 557us (738us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787864996.559584:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:3.0:1787864996.562292:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.562526:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071317888 00000100:00100000:0.0:1787864996.562534:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071317888 00000100:00100000:1.0:1787864996.565680:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:1.0:1787864996.565692:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071317888:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787864996.565728:0:5850:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787864996.565835:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210d4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071317888:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 144us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.565843:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:1.0:1787864996.576734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.576834:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071318144 00000100:00100000:2.0:1787864996.576845:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071318144 00000100:00100000:2.0:1787864996.576918:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:2.0:1787864996.576929:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071318144:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.576949:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864996.576953:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864996.576977:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe18619250b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b78 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.577008:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864996.577014:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864996.577028:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619255f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b8d expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864996.577932:0:8208:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787864996.578121:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.578136:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.578146:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.578200:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe18619255f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b8d expref: 58 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.578215:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b8d expref: 57 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.578222:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa206f51000) 00010000:00010000:2.0:1787864996.578225:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864996.578227:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580800, rc 0) 00000100:00100000:2.0:1787864996.578287:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11507:x1874712071318144:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1563us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787864996.578295:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:3.0:1787864996.582373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.582469:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071318400 00000100:00100000:2.0:1787864996.582479:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071318400 00000100:00100000:2.0:1787864996.582610:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:2.0:1787864996.582621:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11507:x1874712071318400:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.582674:0:10329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864996.582700:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b8d expref: 57 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582717:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa206f51000) 00010000:00010000:2.0:1787864996.582725:0:10329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864996.582746:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582759:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582768:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582781:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582788:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.582794:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583057:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583074:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583080:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583086:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.583090:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583098:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583108:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864996.583110:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.583114:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583121:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192574 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583132:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583137:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583142:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583147:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.583156:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583162:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583170:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa89b7dcc (ffff9fa206f51600) 00010000:00010000:2.0:1787864996.583173:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.583176:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.583181:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619257b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa89b7dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.583447:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071318400:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 826us (1080us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864996.583455:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:3.0:1787864996.585802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.585895:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071318528 00000100:00100000:1.0:1787864996.585904:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071318528 00000100:00100000:1.0:1787864996.585961:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:1.0:1787864996.585971:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11507:x1874712071318528:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864996.585992:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864996.586015:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b94 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586049:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586061:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586072:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586176:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe186192582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586194:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.586202:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864996.586205:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864996.586208:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b800, rc 0) 00000100:00100000:1.0:1787864996.586272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11507:x1874712071318528:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 303us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.586280:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:1.0:1787864996.589780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.590444:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071318784 00000100:00100000:2.0:1787864996.590454:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071318784 00000100:00100000:2.0:1787864996.590524:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 178 00000100:00100000:2.0:1787864996.590535:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11507:x1874712071318784:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.590610:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.590625:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.590637:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864996.590906:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787864996.590929:0:8208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312530531522ns, next at 313530529322ns, rc = 0 00000004:00010000:2.0:1787864996.591013:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fca7530f reply state 000000004058083b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.591022:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864996.591123:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11507:x1874712071318784:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 590us (1351us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787864996.591131:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 178 00000100:00100000:2.0:1787864996.597091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:1.0:1787864996.597322:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597335:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597355:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597362:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864996.597367:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597374:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597422:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:1.0:1787864996.597425:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787864996.597430:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.597437:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.597588:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071318912 00000100:00100000:2.0:1787864996.597597:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071318912 00000100:00100000:2.0:1787864996.597649:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:2.0:1787864996.597659:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+58:11507:x1874712071318912:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.597679:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864996.597696:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7b9b expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.597747:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 59 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.597760:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 59 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.597777:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864996.597780:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864996.597782:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581800, rc 0) 00000100:00100000:2.0:1787864996.597843:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11507:x1874712071318912:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 184us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.597861:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:3.0:1787864996.602865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.602955:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071319040 00000100:00100000:0.0:1787864996.602964:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071319040 00000100:00100000:0.0:1787864996.603036:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787864996.603047:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071319040:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787864996.603686:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071319040:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 639us (828us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787864996.603696:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00080000:3.0:1787864996.604070:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864996.617840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.617910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071319296 00000100:00100000:0.0:1787864996.617920:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071319296 00000100:00100000:0.0:1787864996.617987:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787864996.617997:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11507:x1874712071319296:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864996.618228:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11507:x1874712071319296:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 230us (396us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787864996.618236:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:1.0:1787864996.628017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.628471:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071319552 00000100:00100000:3.0:1787864996.628492:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071319552 00000100:00100000:3.0:1787864996.628546:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:3.0:1787864996.628555:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11507:x1874712071319552:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787864996.628654:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11507:x1874712071319552:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 99us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864996.628673:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:1.0:1787864996.633279:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.633384:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071319680 00000100:00100000:2.0:1787864996.633433:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071319680 00000100:00100000:2.0:1787864996.633550:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:2.0:1787864996.633563:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11507:x1874712071319680:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.633583:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864996.633605:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619259e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ba2 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633672:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633687:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633700:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864996.633735:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864996.633754:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633781:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619259e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba2 expref: 62 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633802:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba2 expref: 61 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.633811:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864996.633826:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864996.633830:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580000, rc 0) 00000100:00100000:2.0:1787864996.633910:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11507:x1874712071319680:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 350us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.633917:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:1.0:1787864996.638773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.638874:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071319808 00000100:00100000:3.0:1787864996.638886:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071319808 00000100:00100000:3.0:1787864996.638965:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787864996.638977:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071319808:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864996.638999:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.639023:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ba9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864996.639058:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a7a5, blocks: 0x1 00010000:00010000:3.0:1787864996.639084:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1787864996.639089:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864996.639101:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.639122:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.639139:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351600, rc 0) 00000100:00100000:3.0:1787864996.639222:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2357:x1874712071319808:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 247us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864996.639230:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:1.0:1787864996.646263:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.646463:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320064 00000100:00100000:3.0:1787864996.646475:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320064 00000100:00100000:3.0:1787864996.646633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:3.0:1787864996.646647:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11507:x1874712071320064:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787864996.646831:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11507:x1874712071320064:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 188us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864996.646841:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:1.0:1787864996.651093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.651212:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320192 00000100:00100000:3.0:1787864996.651225:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320192 00000100:00100000:3.0:1787864996.651315:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787864996.651329:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+8:11507:x1874712071320192:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864996.651352:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864996.651377:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bb0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.651454:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.651466:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864996.651471:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864996.651478:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.651618:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.651638:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 9 pid: 6696 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.651657:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087041920:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864996.651777:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2116b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864996.656196:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874712087041920:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864996.656197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.656243:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320320 00010000:00010000:1.0:1787864996.656244:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.656252:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320320 00010000:00010000:1.0:1787864996.656275:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00010000:00010000:3.0:1787864996.656299:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 10 pid: 6696 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.656342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:3.0:1787864996.656361:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20817dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071320320:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864996.656379:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864996.656430:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 10 pid: 6696 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.656512:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 10 pid: 6696 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.657377:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013ed0373/0xa63eebe1861925ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba9 expref: 10 pid: 6696 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.657432:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864996.657438:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864996.657449:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.657460:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.657523:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.657722:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ed0f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874712087042048:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787864996.660000:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+9:11507:x1874712071320192:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 8659us (8906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.660016:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787864996.661391:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b447a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864996.666190:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ed0f0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1874712087042048:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787864996.666229:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864996.666304:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20817dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071320320:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 9943us (10114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.666318:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:1.0:1787864996.669021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.669326:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320448 00000100:00100000:2.0:1787864996.669337:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320448 00002000:00100000:2.0:1787864996.669437:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa22ea3e580 x1874712071320448/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:92/0 lens 504/0 e 0 to 0 dl 1787865007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864996.669450:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22ea3e580 with x1874712071320448 ext(0->8) 00002000:00010000:2.0:1787864996.669456:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22ea3e580 00000100:00100000:2.0:1787864996.669503:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787864996.669515:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071320448:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787864996.671058:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2359:x1874712071320448:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 1536us (2038us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787864996.671074:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00002000:00100000:2.0:1787864996.671086:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa22ea3e580 x1874712071320448/t4294967314(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:92/0 lens 504/448 e 0 to 0 dl 1787865007 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864996.671105:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22ea3e580 with x1874712071320448 ext(0->8) 00002000:00010000:2.0:1787864996.671112:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22ea3e580 00000100:00100000:0.0:1787864996.679258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.679391:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320576 00000100:00100000:1.0:1787864996.679444:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320576 00000100:00100000:1.0:1787864996.679520:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 183 00000100:00100000:1.0:1787864996.679533:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11507:x1874712071320576:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787864996.732964:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11507:x1874712071320576:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 53424us (53710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.732977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 183 00000001:00080000:0.0:1787864996.732988:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1787864996.733081:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787864996.733106:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa23b446f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787864996.733112:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2059b8800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa23b446540 00000020:00080000:0.0:1787864996.733115:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2059b8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa20e72b400 00000020:00080000:2.0:1787864996.733161:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1787864996.733274:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087042176:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1787864996.733379:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787864996.733429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787864996.733491:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1787864996.733599:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087042176 00000100:00100000:1.0:1787864996.733609:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087042176 00000100:00100000:0.0:1787864996.733652:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787864996.733656:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864996.733663:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087042304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787864996.733682:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787864996.733696:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087042176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787864996.733722:0:6696:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:0.0:1787864996.733729:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1787864996.733760:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90a7a2, atime: 0x0, ctime: 0x6a90a7a2, blocks: 0xb 00000100:00100000:3.0:1787864996.733766:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087042304 00010000:00010000:1.0:1787864996.733772:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.733774:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087042304 00010000:00010000:1.0:1787864996.733795:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:1.0:1787864996.733801:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864996.733809:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.733833:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00010000:00010000:1.0:1787864996.733841:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.733843:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087042304:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787864996.733864:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.733872:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.733919:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787864996.734034:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:2.0:1787864996.734034:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787864996.734038:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787864997 00010000:00010000:2.0:1787864996.734044:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.734057:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864996.734062:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.734074:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.734098:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.734108:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861925ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864996.734115:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787864996.734117:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787864997 -> 1787864997 00002000:00010000:3.0:1787864996.734120:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1787864996.734136:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864996.734138:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864996.734142:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864996.734173:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087042304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 330us (452us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787864996.734183:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1787864996.734202:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa23b9df480/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787864996.734210:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087042304:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787864996.734321:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864996.734615:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087042176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 921us (1184us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787864996.734626:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787864996.734654:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787864996.734663:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787864996.734924:0:3317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa22ea3d2c0 x1874712087042176/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787865012 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787864996.734935:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22ea3d2c0/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787864996.734940:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087042176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787864996.743477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.743905:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320704 00000100:00100000:2.0:1787864996.743915:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320704 00000100:00100000:2.0:1787864996.743982:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787864996.743993:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2359:x1874712071320704:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787864996.847290:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2359:x1874712071320704:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 103288us (103811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.847305:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000001:00080000:3.0:1787864996.848032:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787864996.848050:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1787864996.848065:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787864996.850908:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864996.851122:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071320960 00000100:00100000:2.0:1787864996.851131:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071320960 00000100:00100000:2.0:1787864996.851185:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 184 00000100:00100000:2.0:1787864996.851195:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11507:x1874712071320960:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.851246:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864996.851272:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861925a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ba2 expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.851290:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864996.851295:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864996.851323:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.851354:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.851364:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864996.851661:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062a8d3d6 reply state 000000005de48ae1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.851671:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864996.851758:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11507:x1874712071320960:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 564us (858us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787864996.851766:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 184 00010000:00010000:2.0:1787864996.853998:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854015:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854023:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854028:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864996.854033:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854041:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854056:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864996.854072:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864996.854078:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.854084:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861925c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.857182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.857263:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321088 00000100:00100000:1.0:1787864996.857273:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321088 00000100:00100000:1.0:1787864996.857345:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787864996.857356:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071321088:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787864996.857657:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787864996.857661:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787864997 -> 1787864996 00002000:00010000:1.0:1787864996.857663:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787864995 00002000:00010000:1.0:1787864996.857665:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787864997 -> 1787864996 00002000:00010000:1.0:1787864996.857667:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787864996.857715:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071321088:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 361us (541us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787864996.857723:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787864996.860287:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864996.860310:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864996.860387:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864996.860654:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087042432 00000100:00100000:3.0:1787864996.860661:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087042432 00000100:00100000:3.0:1787864996.860721:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787864996.860730:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087042432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864996.860763:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787864996.860819:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864996.860827:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787864996.860876:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787864996.860882:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa23b9df480, transno 4294967315 00000100:00100000:3.0:1787864996.860900:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864996.861763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.861879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321344 00000100:00100000:3.0:1787864996.861886:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321344 00000100:00100000:3.0:1787864996.861929:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:3.0:1787864996.862023:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11507:x1874712071321344:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787864996.862082:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.862100:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.862109:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.862141:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.862154:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 18 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.862167:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087042560:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864996.862241:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864996.865970:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087042560:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864996.866000:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864996.870001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.871561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321472 00000100:00100000:3.0:1787864996.871635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321472 00010000:00010000:2.0:1787864996.871857:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 19 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.871907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787864996.871917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:2358:x1874712071321472:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864996.871950:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864996.873987:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 19 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874010:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 19 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874036:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b94 expref: 19 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874055:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:2.0:1787864996.874060:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874089:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874096:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.874135:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864996.874255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:2358:x1874712071321472:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2338us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.874264:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00010000:00010000:3.0:1787864996.874360:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874369:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874424:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874432:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874439:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874445:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.874449:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874457:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874466:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:3.0:1787864996.874469:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787864996.874473:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.874492:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.874558:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+17:11507:x1874712071321344:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 12538us (12798us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787864996.874567:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:1.0:1787864996.879999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864996.883839:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321600 00000100:00100000:3.0:1787864996.883854:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321600 00000100:00100000:2.0:1787864996.884202:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:2.0:1787864996.884213:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071321600:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787864996.884255:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.884274:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.884282:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864996.884286:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864996.884291:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.884323:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.884338:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 8 pid: 6695 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.884364:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087042688:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864996.884467:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b88db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864996.889498:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087042688:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864996.889528:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.889705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.889885:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321728 00000100:00100000:1.0:1787864996.889892:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321728 00010000:00010000:1.0:1787864996.889924:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864996.889975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787864996.889984:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071321728:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864996.890002:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864996.890022:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.890035:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.890054:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe1861925b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb0 expref: 9 pid: 6695 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.890068:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864996.890072:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864996.890077:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.890086:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.890111:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864996.890137:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890149:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864996.890160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071321728:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 176us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.890169:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00010000:00010000:2.0:1787864996.890174:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890184:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890193:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890201:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864996.890205:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890228:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890240:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864996.890248:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f51a634/0xa63eebe1861925cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864996.890292:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2359:x1874712071321600:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 6080us (10302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864996.890300:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787864996.892567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.892629:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071321984 00000100:00100000:1.0:1787864996.892636:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071321984 00000100:00100000:1.0:1787864996.892683:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 186 00000100:00100000:1.0:1787864996.892693:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+17:11507:x1874712071321984:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787864996.892772:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.892788:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.892799:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.892987:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.892998:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 18 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.893007:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.893039:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 18 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.893052:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 18 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864996.893066:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087042816:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864996.893143:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787864996.896998:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087042816:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864996.897035:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864996.897166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864996.900361:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071322112 00000100:00100000:0.0:1787864996.900374:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071322112 00010000:00010000:0.0:1787864996.900434:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 19 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864996.900500:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787864996.900510:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+19:2359:x1874712071322112:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864996.900526:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864996.900920:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 19 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.900935:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 19 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.900961:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b9b expref: 19 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.900977:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:0.0:1787864996.900983:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.900992:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.901000:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.901075:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864996.901136:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+18:2359:x1874712071322112:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 626us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.901144:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00010000:00010000:1.0:1787864996.901194:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.901331:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864996.902555:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787864996.902718:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787864996.902773:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787864996.902855:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874712087042944:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787864996.903101:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864996.903615:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864996.903662:0:11973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087042944 00000100:00100000:0.0:1787864996.903676:0:11973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087042944 00000100:00100000:0.0:1787864996.903736:0:11973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864996.903745:0:11973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5849:x1874712087042944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787864996.903841:0:11973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5849:x1874712087042944:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864996.903849:0:11973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864996.904025:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874712087042944:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787864996.904579:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787864996.904644:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874712087043072:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787864996.904694:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864996.904756:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864996.904958:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087043072 00000100:00100000:3.0:1787864996.904964:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087043072 00000100:00100000:0.0:1787864996.904998:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787864996.905009:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874712087043072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787864996.905220:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874712087043072:12345-0@lo:1000:mdt00_000.0 Request processed in 214us (525us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787864996.905227:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864996.906836:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1874712087043072:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787864996.906879:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906891:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906898:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906905:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.906909:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906917:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170900) 00010000:00010000:3.0:1787864996.906943:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864996.906948:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906955:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861925dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906985:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.906991:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907053:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907061:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864996.907064:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907070:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907080:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:3.0:1787864996.907083:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864996.907087:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907093:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492800/0xa63eebe186192512 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907201:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907217:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 21 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907226:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907258:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 21 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864996.907274:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 21 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864996.907287:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087043200:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864996.907373:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210d659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864996.915492:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087043200:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864996.915509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:3.0:1787864996.915524:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864996.915695:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071322240 00000100:00100000:0.0:1787864996.915702:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071322240 00010000:00010000:0.0:1787864996.915735:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 22 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864996.915765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:0.0:1787864996.915774:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+22:2359:x1874712071322240:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864996.915787:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864996.915793:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 22 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.916622:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 22 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.916647:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619252e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7b7f expref: 22 pid: 10329 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.916675:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:0.0:1787864996.916680:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.916689:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.916698:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.916956:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864996.917061:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917075:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917090:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917100:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917112:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917123:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864996.917129:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917137:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917160:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:0.0:1787864996.917172:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864996.917177:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917188:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917203:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917211:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917221:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917232:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864996.917235:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917241:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917256:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:0.0:1787864996.917259:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864996.917264:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864996.917271:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861925d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864996.917291:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+21:2359:x1874712071322240:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1514us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864996.917307:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:0.0:1787864996.917554:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:11507:x1874712071321984:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 24861us (24991us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787864996.917564:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 186 00000020:00080000:0.0:1787864996.917568:0:5849:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787864996.918633:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864996.918641:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864996.920281:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787864996.920294:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864996.939261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864996.939298:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071322496 00000100:00100000:1.0:1787864996.939307:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071322496 00000100:00100000:1.0:1787864996.939356:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787864996.939368:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:11507:x1874712071322496:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787864996.940244:0:5852:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787864996.940366:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787864996.940436:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940454:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940468:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940476:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940493:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940499:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.940885:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787864996.940977:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:11507:x1874712071322496:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1610us (1724us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787864996.940986:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000020:00080000:1.0:1787864996.940991:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787864996.941043:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864996.941050:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.941057:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864996.941061:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.941068:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.941089:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787864996.941092:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864996.941098:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.941994:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe1861925eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864996.942013:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864996.942016:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864996.942018:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864996.942024:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864997.212697:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864997.212706:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864997.212754:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787864997.212760:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787864997.354898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.355035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071322752 00000100:00100000:3.0:1787864997.355046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071322752 00000100:00100000:3.0:1787864997.355106:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:3.0:1787864997.355115:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+22:11517:x1874712071322752:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864997.355139:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.355159:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bb7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.355443:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861925f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.355459:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861925f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.355473:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861925f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864997.356597:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787864997.357115:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861925f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb7 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.357138:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861925f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb7 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.357148:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.357151:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864997.357156:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350600, rc 0) 00000100:00100000:3.0:1787864997.357227:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11517:x1874712071322752:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2112us (2414us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787864997.357236:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:2.0:1787864997.366369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.366475:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071322880 00000100:00100000:3.0:1787864997.366494:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071322880 00000100:00100000:3.0:1787864997.366549:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:3.0:1787864997.366619:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11517:x1874712071322880:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787864997.366704:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.366762:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.366775:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.366790:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.366798:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.366805:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367111:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367121:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367128:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864997.367165:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367177:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367183:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367200:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367206:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.367211:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367218:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367231:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.367235:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.367239:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367245:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367259:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367265:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367271:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367276:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.367279:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367295:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367303:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.367305:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.367308:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367314:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619260e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367329:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367335:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367341:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367347:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.367350:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367356:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367363:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dc600) 00010000:00010000:3.0:1787864997.367366:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.367369:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.367385:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864997.367513:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11517:x1874712071322880:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 895us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.367522:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:0.0:1787864997.450989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.451969:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071323136 00000100:00100000:3.0:1787864997.451980:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071323136 00000100:00100000:3.0:1787864997.452095:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:3.0:1787864997.452106:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11520:x1874712071323136:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864997.452241:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.452264:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619261c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bbe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452342:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452358:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452368:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452383:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452390:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.452695:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454099:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454123:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454133:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864997.454144:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787864997.454223:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454231:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454237:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454243:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.454247:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454255:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454266:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.454269:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.454279:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454285:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454298:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454304:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454309:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454314:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.454317:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454322:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454329:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc600) 00010000:00010000:3.0:1787864997.454331:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.454334:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454339:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619262a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454379:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe18619261c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454420:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.454429:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.454431:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864997.454433:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864997.454515:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11520:x1874712071323136:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2410us (3534us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787864997.454524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:0.0:1787864997.457871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.457981:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071323264 00000100:00100000:3.0:1787864997.457990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071323264 00000100:00100000:3.0:1787864997.458050:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:3.0:1787864997.458061:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11520:x1874712071323264:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:3.0:1787864997.458121:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458138:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458150:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458176:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458183:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458206:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458212:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.458217:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458224:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458235:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.458238:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864997.458242:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.458248:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619263f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864997.458323:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ed0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11520:x1874712071323264:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 263us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.458330:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:0.0:1787864997.461283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864997.461359:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071323520 00000100:00100000:1.0:1787864997.461368:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071323520 00000100:00100000:1.0:1787864997.461457:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787864997.461468:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11520:x1874712071323520:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864997.461692:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+27:11520:x1874712071323520:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 226us (427us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787864997.461699:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787864997.505168:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864997.505287:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071323776 00000100:00100000:2.0:1787864997.505297:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071323776 00000100:00100000:2.0:1787864997.505353:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:2.0:1787864997.505363:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+27:11055:x1874712071323776:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787864997.505386:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864997.505446:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192646 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bc5 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.505543:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.505559:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.505580:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.505609:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.505622:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 28 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864997.505635:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087043328:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864997.505719:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20ddbf540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864997.508687:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874712087043328:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864997.508722:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864997.509894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864997.510890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071323904 00000100:00100000:2.0:1787864997.510898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071323904 00010000:00010000:2.0:1787864997.510936:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 29 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864997.510974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787864997.510982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+29:2359:x1874712071323904:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864997.510996:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864997.511002:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 29 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511030:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 29 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511051:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bbe expref: 29 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511068:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:2.0:1787864997.511073:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511082:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511090:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.511117:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864997.511154:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.511164:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864997.511173:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+28:2359:x1874712071323904:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 191us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864997.511181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000004:00200000:3.0:1787864997.511183:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787864997.511351:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192646 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 29 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.511380:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 28 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.511388:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.511391:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864997.511393:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581c00, rc 0) 00000100:00100000:3.0:1787864997.511492:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11055:x1874712071323776:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6130us (6334us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787864997.511500:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:0.0:1787864997.517825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864997.517915:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324160 00000100:00100000:2.0:1787864997.517924:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324160 00000100:00100000:2.0:1787864997.517979:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 192 00000100:00100000:2.0:1787864997.517988:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11055:x1874712071324160:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:2.0:1787864997.518218:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.518233:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864997.518255:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864997.518305:0:10329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787864997.518332:0:10329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cad0d228 reply state 00000000d443411c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864997.518340:0:10329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787864997.518384:0:10329:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787864997.518530:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa205896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11055:x1874712071324160:12345-192.168.206.10@tcp:36:bash.0 Request processed in 542us (714us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787864997.518538:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 192 00000020:00080000:2.0:1787864997.518542:0:10329:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787864997.520316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.520546:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324288 00000100:00100000:3.0:1787864997.520555:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324288 00000100:00100000:3.0:1787864997.520610:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:3.0:1787864997.520619:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11055:x1874712071324288:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864997.520638:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.520657:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bcc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.520709:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bcc expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.520723:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bcc expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.520740:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.520744:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864997.520757:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787864997.520823:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+33:11055:x1874712071324288:12345-192.168.206.10@tcp:101:bash.0 Request processed in 205us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.520830:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 193 00010000:00010000:1.0:1787864997.521042:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521051:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521069:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521075:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864997.521079:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521088:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521100:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:1.0:1787864997.521102:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864997.521106:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864997.521113:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe18619265b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864997.533637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.534045:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324416 00000100:00100000:3.0:1787864997.534054:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324416 00000100:00100000:3.0:1787864997.534111:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787864997.534120:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:11055:x1874712071324416:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864997.534138:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.534158:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bd3 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864997.534184:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90a7a4, atime: 0x6a90a7a3, ctime: 0x6a90a7a4, blocks: 0xb 00010000:00010000:3.0:1787864997.534204:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1787864997.534209:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864997.534217:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.534234:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.534247:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00000100:00100000:3.0:1787864997.534347:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:11055:x1874712071324416:12345-192.168.206.10@tcp:101:bash.0 Request processed in 229us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.534355:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787864997.543756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864997.543849:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324544 00000100:00100000:1.0:1787864997.543858:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324544 00002000:00010000:1.0:1787864997.543898:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787864997.543903:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f3e9680 with x1874712071324544 ext(0->18446744073709551615) 00002000:00010000:1.0:1787864997.543914:0:6700:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f3e9680. 00000100:00100000:1.0:1787864997.543949:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787864997.543957:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071324544:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:1.0:1787864997.544199:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787864997.544202:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787864996 -> 1787864998 00002000:00010000:1.0:1787864997.544218:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787864995 -> 1787864995 00002000:00010000:1.0:1787864997.544220:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787864996 -> 1787864998 00002000:00010000:1.0:1787864997.544222:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787864997.544290:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2358:x1874712071324544:12345-192.168.206.10@tcp:10:bash.0 Request processed in 333us (601us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787864997.544297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00002000:00010000:1.0:1787864997.544301:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787864997.544304:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa22f3e9680 with x1874712071324544 ext(0->18446744073709551615) 00002000:00010000:1.0:1787864997.544308:0:6700:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa22f3e9680. 00000100:00100000:0.0:1787864997.646793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.647550:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324672 00000100:00100000:3.0:1787864997.647583:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324672 00000100:00100000:3.0:1787864997.647667:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:3.0:1787864997.647827:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2058970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11534:x1874712071324672:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787864997.647934:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.647956:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.647969:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.647986:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.648221:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.648231:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.650270:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.650292:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.650304:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864997.650370:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.650436:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651073:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651086:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651093:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.651098:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651108:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651123:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.651127:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.651132:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651140:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192670 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651160:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651167:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651174:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651189:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.651192:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651199:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651208:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864997.651211:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.651214:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651220:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651241:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651248:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651254:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651260:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.651263:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651270:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651287:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.651290:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.651293:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.651300:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619267e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864997.652154:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2058970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11534:x1874712071324672:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 4463us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.652170:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:2.0:1787864997.793024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.793260:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071324928 00000100:00100000:3.0:1787864997.793270:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071324928 00000100:00100000:3.0:1787864997.793332:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:3.0:1787864997.793342:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+32:11537:x1874712071324928:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864997.793364:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.793388:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bda expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793796:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793873:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793888:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793903:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793924:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.793931:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794354:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe18619269a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794364:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe18619269a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794371:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe18619269a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864997.794382:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787864997.794668:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794678:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794684:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794690:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.794695:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794703:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794727:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.794730:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.794736:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794743:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619268c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794758:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794764:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794770:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794775:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.794778:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794785:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794792:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864997.794794:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.794797:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794802:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794935:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bda expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794949:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe18619269a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bda expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.794957:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.794959:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787864997.794962:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864997.795084:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+34:11537:x1874712071324928:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1743us (2067us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787864997.795101:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:2.0:1787864997.798384:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864997.798645:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071325056 00000100:00100000:0.0:1787864997.798654:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071325056 00000100:00100000:0.0:1787864997.798708:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:0.0:1787864997.798718:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+34:11537:x1874712071325056:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787864997.798788:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.798806:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 34 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.798975:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.799022:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 34 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.799037:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 34 pid: 8208 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864997.799053:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b769a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087043456:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787864997.799457:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91780 going to sleep for 11 seconds 00000100:00100000:3.0:1787864997.802323:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b769a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1874712087043456:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864997.802352:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864997.811679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864997.811787:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071325312 00000100:00100000:1.0:1787864997.811797:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071325312 00000100:00100000:1.0:1787864997.811859:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:1.0:1787864997.811869:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:5591:x1874712071325312:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787864997.812178:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:5591:x1874712071325312:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 309us (507us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787864997.812186:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787864997.823145:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.823779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071325440 00000100:00100000:3.0:1787864997.823788:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071325440 00010000:00010000:3.0:1787864997.823992:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 36 pid: 8208 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864997.824037:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:3.0:1787864997.824049:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:2359:x1874712071325440:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864997.824065:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864997.824072:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 36 pid: 8208 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824110:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 36 pid: 8208 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824136:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe18619264d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bc5 expref: 36 pid: 8208 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824154:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.824159:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824169:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824176:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.824374:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864997.824464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+35:2359:x1874712071325440:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 417us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864997.824484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00010000:00010000:0.0:1787864997.825007:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825018:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825045:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825053:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825060:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825066:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864997.825071:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825079:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825097:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:0.0:1787864997.825100:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864997.825104:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864997.825110:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe1861926a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864997.825167:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+34:11537:x1874712071325056:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 26450us (26791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864997.825175:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:0.0:1787864997.834811:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864997.834864:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071325696 00000100:00100000:1.0:1787864997.834874:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071325696 00000100:00100000:1.0:1787864997.834945:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:1.0:1787864997.834956:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+34:11537:x1874712071325696:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864997.835765:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11537:x1874712071325696:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 808us (959us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787864997.835775:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00010000:00010000:2.0:1787864997.947593:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864997.972659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864997.972791:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071325952 00000100:00100000:3.0:1787864997.972800:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071325952 00000100:00100000:3.0:1787864997.972858:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:3.0:1787864997.972868:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+35:11548:x1874712071325952:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787864997.972890:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864997.972909:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7be1 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.972988:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973012:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973023:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973036:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973042:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973049:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973330:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861926c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973340:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861926c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973347:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861926c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864997.973357:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787864997.973487:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973496:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973508:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973514:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.973518:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973525:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973537:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864997.973541:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.973545:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973551:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861926b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973565:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973572:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973579:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973584:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864997.973588:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973603:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973611:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:3.0:1787864997.973613:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864997.973616:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973622:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973661:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be1 expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973674:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861926c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be1 expref: 37 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864997.973680:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864997.973683:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864997.973685:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2aa00, rc 0) 00000100:00100000:3.0:1787864997.974119:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+37:11548:x1874712071325952:12345-192.168.206.10@tcp:101:cat.0 Request processed in 1251us (1467us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787864997.974127:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:2.0:1787864997.982278:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864997.982501:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071326208 00000100:00100000:0.0:1787864997.982511:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071326208 00000100:00100000:0.0:1787864997.982882:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787864997.982893:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+37:11548:x1874712071326208:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787864997.983130:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11548:x1874712071326208:12345-192.168.206.10@tcp:35:cat.0 Request processed in 238us (860us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787864997.983138:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787864998.003118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.003283:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071326464 00000100:00100000:3.0:1787864998.003293:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071326464 00000100:00100000:3.0:1787864998.003501:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 198 00000100:00100000:3.0:1787864998.003513:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11549:x1874712071326464:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787864998.003648:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787864998.003674:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861926c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be1 expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003698:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe18619269a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bda expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003710:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bcc expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003719:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dcc00) 00010000:00010000:3.0:1787864998.003729:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864998.003748:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003759:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003777:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003790:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003796:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.003803:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.004220:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.004229:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.004237:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864998.005327:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787864998.005337:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313944940171ns, next at 314944937956ns, rc = 0 00010000:00010000:3.0:1787864998.005626:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005638:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005646:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005654:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005660:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005667:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005689:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864998.005711:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005725:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864998.005726:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005735:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005736:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005751:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864998.005755:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005771:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787864998.005773:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005777:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.005787:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dca00) 00010000:00010000:3.0:1787864998.005791:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787864998.005796:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005796:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005818:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa20c8dca00) 00010000:00010000:1.0:1787864998.005822:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864998.005826:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005832:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861926e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.005846:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864998.005847:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864998.005849:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864998.005988:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787864998.006055:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe1861926e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006080:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006087:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006093:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006098:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ae00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864998.006107:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006114:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006123:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864998.006126:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864998.006129:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.006135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861926d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864998.006148:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b3a5c2e reply state 00000000a7b4fd65 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864998.006157:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864998.006245:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b769a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+37:11549:x1874712071326464:12345-192.168.206.10@tcp:36:rm.0 Request processed in 2731us (3132us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787864998.006254:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 198 00010000:00010000:0.0:1787864998.007819:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007834:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007841:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007859:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864998.007864:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007872:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007886:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dc800) 00010000:00010000:0.0:1787864998.007888:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864998.007892:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.007897:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861926d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864998.057756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.058063:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071326720 00000100:00100000:0.0:1787864998.058073:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071326720 00000100:00100000:0.0:1787864998.058167:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:0.0:1787864998.058176:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+36:11555:x1874712071326720:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864998.058196:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864998.058215:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe1861926ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7be8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058329:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058354:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058382:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058417:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058425:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.058432:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864998.058985:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787864998.059153:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059163:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059171:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059209:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059216:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059224:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059230:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864998.059241:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059249:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059263:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:0.0:1787864998.059266:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864998.059271:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059277:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe1861926f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864998.059289:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003222f1a7 reply state 00000000618b98ee transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864998.059297:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787864998.059326:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493e00/0xa63eebe1861926ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059338:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.059345:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:0.0:1787864998.059347:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864998.059350:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492600, rc 0) 00000100:00100000:0.0:1787864998.059513:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+39:11555:x1874712071326720:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1336us (1763us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787864998.059521:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 199 00010000:00010000:1.0:1787864998.062288:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062304:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062311:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062317:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864998.062323:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062342:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062359:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20378b500) 00010000:00010000:1.0:1787864998.062362:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864998.062366:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.062386:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe1861926fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864998.066449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.068643:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071326848 00000100:00100000:2.0:1787864998.068657:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071326848 00000100:00100000:2.0:1787864998.068745:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787864998.068757:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071326848:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787864998.068773:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864998.068793:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bef expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864998.068838:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787864998.068857:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=314s v=(0 0) 00010000:00010000:2.0:1787864998.068862:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864998.068873:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.068891:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.068904:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581600, rc 0) 00000100:00080000:0.0:1787864998.068914:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864998.068969:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106c35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071326848:12345-192.168.206.10@tcp:101:bash.0 Request processed in 215us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.068976:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787864998.072175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.073736:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071326976 00000100:00100000:3.0:1787864998.073748:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071326976 00000100:00100000:3.0:1787864998.073817:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787864998.073828:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+6:11555:x1874712071326976:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787864998.073845:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.073863:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bf6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.074008:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.074027:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864998.074032:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864998.074037:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.074068:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.074081:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864998.074095:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087043584:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864998.074314:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864998.076221:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1874712087043584:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864998.076259:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.076280:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864998.076335:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:11555:x1874712071326976:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2508us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.076355:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:1.0:1787864998.078077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.078180:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071327104 00000100:00100000:2.0:1787864998.078188:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071327104 00010000:00010000:2.0:1787864998.078226:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.078317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:2.0:1787864998.078327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2359:x1874712071327104:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.078342:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.078366:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.078430:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.078454:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bef expref: 7 pid: 6695 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.078470:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864998.078488:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864998.078497:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.078508:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.078546:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.078561:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3e92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874712087043712:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787864998.078644:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210f81000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864998.081582:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3e92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5835:1874712087043712:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787864998.081609:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864998.081712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2359:x1874712071327104:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 3385us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864998.081723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:3.0:1787864998.083495:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.083601:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071327360 00000100:00100000:1.0:1787864998.083608:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071327360 00000100:00100000:1.0:1787864998.083656:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:1.0:1787864998.083667:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+38:11555:x1874712071327360:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787864998.084010:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+39:11555:x1874712071327360:12345-192.168.206.10@tcp:35:bash.0 Request processed in 343us (521us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787864998.084017:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:1.0:1787864998.248111:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.248196:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071327488 00000100:00100000:3.0:1787864998.248206:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071327488 00000100:00100000:3.0:1787864998.248283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:3.0:1787864998.248292:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+39:11571:x1874712071327488:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864998.248311:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.248331:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619271f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7bfd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248392:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248432:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248443:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864998.248511:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787864998.248515:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864998.248537:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248561:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe18619271f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bfd expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248580:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bfd expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.248588:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864998.248591:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864998.248595:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864998.248654:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+40:11571:x1874712071327488:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 362us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.248667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:2.0:1787864998.252592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.252670:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071327744 00000100:00100000:3.0:1787864998.252679:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071327744 00000100:00100000:3.0:1787864998.252736:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:3.0:1787864998.252746:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+40:11571:x1874712071327744:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864998.252766:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.252786:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619272d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c04 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.252891:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.252904:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.252915:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864998.252926:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787864998.253046:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe18619272d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c04 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.253066:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c04 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.253075:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:3.0:1787864998.253078:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864998.253081:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864998.253157:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+42:11571:x1874712071327744:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 412us (572us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787864998.253164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:0.0:1787864998.257295:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.257378:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328000 00000100:00100000:3.0:1787864998.257388:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328000 00000100:00100000:3.0:1787864998.257504:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:3.0:1787864998.257515:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+42:11571:x1874712071328000:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864998.257537:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.257574:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c0b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.257681:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.257694:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.257705:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864998.257717:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787864998.257839:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351400/0xa63eebe186192742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c0b expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.257858:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c0b expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.257866:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:3.0:1787864998.257869:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787864998.257878:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa22ec2b200, rc 0) 00000100:00100000:3.0:1787864998.257940:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+44:11571:x1874712071328000:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 427us (653us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787864998.257948:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:1.0:1787864998.260697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.260794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328128 00000100:00100000:2.0:1787864998.260804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328128 00000100:00100000:2.0:1787864998.260883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787864998.260893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+44:2359:x1874712071328128:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.260923:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.260945:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe186192734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c04 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.260964:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:2.0:1787864998.260969:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864998.261020:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+43:2359:x1874712071328128:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 129us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.261028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787864998.266091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.266171:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328256 00000100:00100000:2.0:1787864998.266180:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328256 00000100:00100000:2.0:1787864998.266237:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:2.0:1787864998.266247:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+6:2358:x1874712071328256:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:2.0:1787864998.266300:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.266320:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.266328:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864998.266332:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864998.266336:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.266364:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.266393:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 6 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.266440:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1874712087043840:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864998.266537:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210f81000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864998.269830:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1874712087043840:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864998.269863:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864998.270504:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.270575:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328384 00000100:00100000:2.0:1787864998.270583:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328384 00002000:00100000:2.0:1787864998.270629:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa20353fc00 x1874712071328384/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:94/0 lens 504/0 e 0 to 0 dl 1787865009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864998.270639:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa20353fc00 with x1874712071328384 ext(0->8) 00010000:00010000:2.0:1787864998.270647:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 7 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.270661:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 7 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864998.270669:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa20353fc00 00000100:00100000:2.0:1787864998.270702:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787864998.270712:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071328384:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:2.0:1787864998.271176:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20353fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2358:x1874712071328384:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 464us (672us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787864998.271185:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:2.0:1787864998.271192:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa20353fc00 x1874712071328384/t4294967308(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:94/0 lens 504/448 e 0 to 0 dl 1787865009 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864998.271200:0:6702:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa20353fc00 with x1874712071328384 ext(0->8) 00010000:00010000:2.0:1787864998.271206:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.271219:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864998.271226:0:6702:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fa20353fc00 00000100:00100000:0.0:1787864998.274516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.274603:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328512 00000100:00100000:1.0:1787864998.274612:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328512 00010000:00010000:1.0:1787864998.274648:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864998.274688:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787864998.274710:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071328512:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864998.274723:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787864998.274740:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787864998.274744:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787864998 00002000:00010000:1.0:1787864998.274746:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787864998 00002000:00010000:1.0:1787864998.274748:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787864998 00010000:00010000:1.0:1787864998.274754:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.274767:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.274789:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192718 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bf6 expref: 9 pid: 6696 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.274804:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864998.274819:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864998.274826:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.274836:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.274870:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864998.274924:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f7e3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071328512:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 216us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864998.274932:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00010000:00010000:2.0:1787864998.275360:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275371:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275438:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275447:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275466:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275483:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864998.275487:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275496:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275507:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.275515:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c53acc1/0xa63eebe186192757 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.275572:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa107e1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071328256:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 9326us (9490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.275580:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787864998.280194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.280287:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328768 00000100:00100000:1.0:1787864998.280296:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328768 00000100:00100000:1.0:1787864998.280347:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787864998.280357:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+43:11571:x1874712071328768:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:1.0:1787864998.280441:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c0b expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864998.280713:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787864998.280751:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787864998.281081:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787864998.281135:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.281149:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.281158:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.281188:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.281202:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 47 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864998.281215:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874712087043968:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864998.281297:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864998.284488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.284687:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5853:1874712087043968:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864998.284724:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.286900:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071328896 00000100:00100000:2.0:1787864998.286912:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071328896 00010000:00010000:2.0:1787864998.286955:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 48 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.286997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787864998.287018:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+48:2359:x1874712071328896:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.287033:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.287040:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 48 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287053:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 48 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287074:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7be8 expref: 48 pid: 5849 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287092:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:2.0:1787864998.287098:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287107:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287114:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.287149:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864998.287203:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+47:2359:x1874712071328896:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 186us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.287211:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00010000:00010000:1.0:1787864998.287528:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.287537:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864998.287667:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787864998.290157:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787864998.290303:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874712087044096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787864998.290364:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864998.290417:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864998.290436:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044096 00000100:00100000:3.0:1787864998.290443:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044096 00000100:00100000:3.0:1787864998.290516:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864998.290527:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1874712087044096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787864998.290612:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1874712087044096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.290619:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864998.290674:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f7840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874712087044096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787864998.291112:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787864998.291166:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c3152c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874712087044224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787864998.291198:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864998.291236:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864998.291250:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044224 00000100:00100000:3.0:1787864998.291255:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044224 00000100:00080000:1.0:1787864998.291287:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864998.291358:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864998.291366:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1874712087044224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787864998.292610:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1874712087044224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1242us (1407us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787864998.292621:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787864998.292796:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c3152c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5853:1874712087044224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787864998.292868:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787864998.293521:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293533:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293541:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293547:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864998.293565:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293574:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293590:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:0.0:1787864998.293593:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787864998.293597:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.293604:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe18619275e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864998.293776:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787864998.295641:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787864998.295660:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314235262495ns, next at 315235259188ns, rc = 0 00000001:00080000:0.0:1787864998.295672:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787864998.295735:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa20378bd00) 00010000:00010000:0.0:1787864998.295740:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864998.295749:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe186192749 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c0b expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864998.295988:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11571:x1874712071328768:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 15632us (15801us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787864998.295999:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000020:00080000:0.0:1787864998.296005:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787864998.300510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.300646:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071329024 00000100:00100000:1.0:1787864998.300654:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071329024 00000100:00100000:1.0:1787864998.300746:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:1.0:1787864998.300756:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+50:11571:x1874712071329024:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787864998.300787:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864998.300807:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c12 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.300861:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192765 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c12 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.300969:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192765 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c12 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.301007:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787864998.301010:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864998.301014:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336b800, rc 0) 00000100:00100000:1.0:1787864998.301106:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+51:11571:x1874712071329024:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 351us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864998.301113:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:2.0:1787864998.305130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.305300:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071329280 00000100:00100000:1.0:1787864998.305310:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071329280 00000100:00100000:1.0:1787864998.305369:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787864998.305379:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+51:11571:x1874712071329280:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864998.305697:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11571:x1874712071329280:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 320us (575us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787864998.305706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:0.0:1787864998.374258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.374438:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071329408 00000100:00100000:2.0:1787864998.374449:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071329408 00000100:00100000:2.0:1787864998.374728:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:2.0:1787864998.374750:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11581:x1874712071329408:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:2.0:1787864998.374832:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374849:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374859:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374874:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374881:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374887:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374984:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374992:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.374999:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864998.375039:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375051:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375065:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375072:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375078:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.375082:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375090:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375101:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864998.375104:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.375108:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375114:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619276c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375127:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375133:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375138:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375143:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.375152:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375159:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375167:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa206f51600) 00010000:00010000:2.0:1787864998.375169:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.375172:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375178:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375191:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375197:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375202:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375207:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.375209:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375214:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375221:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864998.375223:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.375232:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.375238:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe18619277a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.375301:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11581:x1874712071329408:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 552us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.375308:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:3.0:1787864998.453963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.454074:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071329664 00000100:00100000:2.0:1787864998.454085:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071329664 00000100:00100000:2.0:1787864998.454143:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:2.0:1787864998.454154:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+52:11584:x1874712071329664:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787864998.454172:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864998.454195:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c19 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454261:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454276:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454288:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454302:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454309:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454332:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454501:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454510:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454518:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864998.454528:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787864998.454621:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454629:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454636:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454642:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.454646:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454654:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454665:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864998.454668:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.454680:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454686:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454701:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454707:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454712:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454718:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.454721:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454726:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454733:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa206f51600) 00010000:00010000:2.0:1787864998.454736:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.454738:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454744:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe18619278f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454779:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580600/0xa63eebe186192781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c19 expref: 55 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454805:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c19 expref: 54 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.454812:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864998.454815:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864998.454817:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581c00, rc 0) 00000100:00100000:2.0:1787864998.454877:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11584:x1874712071329664:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 725us (922us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787864998.454885:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:0.0:1787864998.469646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.469690:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071329792 00000100:00100000:1.0:1787864998.469700:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071329792 00000100:00100000:1.0:1787864998.469814:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:1.0:1787864998.469826:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11584:x1874712071329792:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787864998.469889:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469906:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469919:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469960:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469967:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469973:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469980:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864998.469985:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.469993:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.470005:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787864998.470008:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864998.470012:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.470019:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864998.470105:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11584:x1874712071329792:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 281us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864998.470114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:0.0:1787864998.473952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.474649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071330048 00000100:00100000:1.0:1787864998.474659:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071330048 00000100:00100000:1.0:1787864998.474756:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:1.0:1787864998.474775:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+54:11584:x1874712071330048:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787864998.475004:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11584:x1874712071330048:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 230us (1059us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787864998.475012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787864998.581602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.581961:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071330304 00000100:00100000:0.0:1787864998.581981:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071330304 00000100:00100000:0.0:1787864998.582039:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:0.0:1787864998.582050:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+55:11594:x1874712071330304:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787864998.582072:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864998.582075:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864998.582099:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bfd expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582119:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:0.0:1787864998.582124:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864998.582138:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe1861927ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c20 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582236:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861927b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582251:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861927b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582262:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861927b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864998.582273:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787864998.582569:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493200/0xa63eebe1861927ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c20 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582585:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861927b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c20 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.582609:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787864998.582612:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864998.582615:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493400, rc 0) 00000100:00100000:0.0:1787864998.582719:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11594:x1874712071330304:12345-192.168.206.10@tcp:101:bash.0 Request processed in 670us (1124us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787864998.582727:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:0.0:1787864998.592490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.592583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071330560 00000100:00100000:3.0:1787864998.592592:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071330560 00000100:00100000:3.0:1787864998.592700:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:3.0:1787864998.592711:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11594:x1874712071330560:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:3.0:1787864998.592875:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787864998.592916:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493400/0xa63eebe1861927b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c20 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.592939:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581c00/0xa63eebe186192796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c19 expref: 55 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.592948:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864998.592952:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864998.593143:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.593155:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.593165:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864998.593213:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787864998.593239:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8bfd0d4 reply state 00000000e6591750 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864998.593249:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864998.594308:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11594:x1874712071330560:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1595us (1833us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787864998.594315:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000020:00080000:3.0:1787864998.594321:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787864998.597277:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597292:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597298:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597303:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2aa00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864998.597325:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597342:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597358:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787864998.597361:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864998.597366:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.597372:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864998.598187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864998.598268:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071330688 00000100:00100000:1.0:1787864998.598294:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071330688 00000100:00100000:1.0:1787864998.598356:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:1.0:1787864998.598366:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+56:11594:x1874712071330688:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787864998.598431:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864998.598450:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861927c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c27 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598536:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598548:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598559:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864998.598586:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787864998.598590:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864998.598607:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598646:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a600/0xa63eebe1861927c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598678:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864998.598686:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787864998.598690:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864998.598692:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a400, rc 0) 00000100:00100000:1.0:1787864998.598750:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11594:x1874712071330688:12345-192.168.206.10@tcp:101:bash.0 Request processed in 385us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864998.598758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:3.0:1787864998.607144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.607313:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071330944 00000100:00100000:2.0:1787864998.607323:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071330944 00000100:00100000:2.0:1787864998.607500:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787864998.607513:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+57:11594:x1874712071330944:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787864998.607945:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+58:11594:x1874712071330944:12345-192.168.206.10@tcp:35:bash.0 Request processed in 432us (808us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787864998.607953:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787864998.700522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.700560:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331072 00000100:00100000:0.0:1787864998.700571:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331072 00000100:00100000:0.0:1787864998.700636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:0.0:1787864998.700647:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+58:11600:x1874712071331072:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787864998.700670:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864998.700690:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe1861927d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c2e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700764:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700779:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700790:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864998.700851:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787864998.700856:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787864998.700879:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700904:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe1861927d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c2e expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700923:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c2e expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.700949:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:0.0:1787864998.700952:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864998.700955:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493a00, rc 0) 00000100:00100000:0.0:1787864998.701031:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071331072:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 386us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864998.701039:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:0.0:1787864998.715606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.715750:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331200 00000100:00100000:3.0:1787864998.715762:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331200 00000100:00100000:3.0:1787864998.715841:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:3.0:1787864998.715861:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071331200:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864998.715882:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.715904:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861927e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c35 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.715970:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.715985:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.715996:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717129:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717141:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717149:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717897:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717910:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.717919:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864998.717979:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787864998.717984:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787864998.718314:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718329:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718339:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718345:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718352:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718358:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2aa00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864998.718362:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718370:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718382:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787864998.718386:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864998.718391:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718429:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2aa00/0xa63eebe1861927ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718458:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718465:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718600:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718606:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864998.718610:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718616:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718625:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa20c8dca00) 00010000:00010000:3.0:1787864998.718628:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864998.718631:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718637:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2b200/0xa63eebe1861927f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718679:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ae00/0xa63eebe1861927e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718695:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.718715:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864998.718718:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864998.718721:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350200, rc 0) 00000100:00100000:3.0:1787864998.718821:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11600:x1874712071331200:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2960us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.718830:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:1.0:1787864998.727697:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.728361:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331456 00000100:00100000:2.0:1787864998.728371:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331456 00000100:00100000:2.0:1787864998.728641:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787864998.728655:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11600:x1874712071331456:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787864998.728676:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864998.728700:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861927ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c3c expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728830:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728858:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728867:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728875:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728912:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.728926:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 61 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.728941:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087044352:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864998.729772:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.729784:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 61 pid: 5850 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.729795:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087044480:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864998.729889:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20ddbf540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864998.738733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.738764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.738839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.738877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331584 00000100:00100000:2.0:1787864998.738887:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331584 00010000:00010000:2.0:1787864998.738937:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 62 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.738970:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331712 00000100:00100000:2.0:1787864998.738972:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331712 00010000:00010000:2.0:1787864998.738985:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 63 pid: 5850 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.738995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071331840 00000100:00100000:2.0:1787864998.738998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071331840 00010000:00010000:2.0:1787864998.739006:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 64 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.739031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787864998.739040:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+64:2359:x1874712071331584:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.739054:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.739060:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 64 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739072:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 64 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739095:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864998.739102:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739120:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739127:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864998.739177:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+64:2359:x1874712071331584:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 137us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.739185:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787864998.739203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787864998.739209:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+63:2359:x1874712071331712:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.739217:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.739222:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 63 pid: 5850 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739232:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 63 pid: 5850 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739243:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864998.739247:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739255:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739263:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.739284:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864998.739302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+63:2359:x1874712071331712:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 93us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.739315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787864998.739327:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787864998.739334:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+62:2356:x1874712071331840:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864998.739342:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864998.739345:0:5836:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a63eebe1861927f8) 00010000:00010000:2.0:1787864998.739347:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864998.739364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+62:2356:x1874712071331840:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 30us (525us total) trans 0 rc 116/116 00000100:00100000:2.0:1787864998.739370:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00010000:00010000:3.0:1787864998.742975:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe1861927f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c35 expref: 61 pid: 5851 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864998.743000:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087044352:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864998.743015:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861927ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c27 expref: 60 pid: 5850 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864998.743026:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10329:1874712087044480:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864998.743049:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.743058:0:10329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.743065:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864998.743087:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787864998.743606:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861927ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 61 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.743643:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 60 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.743652:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864998.743655:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864998.743658:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580400, rc 0) 00000100:00100000:3.0:1787864998.743851:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11600:x1874712071331456:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 15199us (16162us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787864998.743861:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787864998.757143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.757243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332096 00000100:00100000:0.0:1787864998.757253:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332096 00000100:00100000:0.0:1787864998.757329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787864998.757341:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11600:x1874712071332096:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:0.0:1787864998.757359:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864998.757385:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c12 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.757561:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787864998.757567:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864998.757615:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071332096:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 277us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864998.758079:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787864998.762021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.762111:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332224 00000100:00100000:3.0:1787864998.762121:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332224 00000100:00100000:3.0:1787864998.762179:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:3.0:1787864998.762189:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071332224:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:3.0:1787864998.762670:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.762690:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.762703:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864998.770984:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787864998.771183:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071332224:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 8989us (9164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.771198:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:1.0:1787864998.775126:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864998.775436:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332352 00000100:00100000:3.0:1787864998.775447:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332352 00000100:00100000:3.0:1787864998.775617:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:3.0:1787864998.775628:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+59:11600:x1874712071332352:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787864998.775649:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864998.775684:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c43 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775924:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775936:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775955:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775970:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775982:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864998.775985:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864998.775989:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864998.775996:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787864998.776059:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11600:x1874712071332352:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 432us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.776066:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:3.0:1787864998.910759:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087044608:0@lo:400:kworker.0 00000100:00100000:3.0:1787864998.910832:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864998.910957:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087044736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.910990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864998.911046:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864998.911053:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087044864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.911075:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864998.911122:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044736 00000100:00100000:2.0:1787864998.911128:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044736 00000100:00100000:2.0:1787864998.911167:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044864 00000100:00100000:2.0:1787864998.911170:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044864 00000100:00100000:2.0:1787864998.911197:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787864998.911205:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087044736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.911265:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087044736:12345-0@lo:400:kworker.0 Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.911273:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787864998.911290:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864998.911296:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087044864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.911322:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874712087044864:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.911328:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864998.911361:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1874712087044864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.911370:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087044736:0@lo:400:kworker.0 00000100:00100000:3.0:1787864998.911508:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087045120:0@lo:400:kworker.0 00000100:00100000:3.0:1787864998.911533:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864998.911570:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864998.911576:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087044992:0@lo:400:kworker.0 00000100:00100000:3.0:1787864998.911601:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864998.911629:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044992 00000100:00100000:3.0:1787864998.911632:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044992 00000100:00100000:3.0:1787864998.911663:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864998.911671:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712087044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864998.911705:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874712087044992:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864998.911711:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864998.911735:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087044992:0@lo:400:kworker.0 00000100:00080000:3.0:1787864998.911763:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864998.911767:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864998.911826:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087045120 00000100:00100000:2.0:1787864998.911831:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087045120 00000100:00100000:2.0:1787864998.911869:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787864998.911875:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087045120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864998.911909:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874712087045120:12345-0@lo:400:kworker.0 Request processed in 35us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.911915:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787864998.911984:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1874712087045120:0@lo:400:kworker.0 00000100:00080000:3.0:1787864998.911999:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864998.912099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087044608 00000100:00100000:1.0:1787864998.912104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087044608 00000100:00100000:1.0:1787864998.912169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787864998.912177:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864998.912218:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3316:x1874712087044608:12345-0@lo:400:kworker.0 Request processed in 42us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864998.912223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787864998.912277:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087044608:0@lo:400:kworker.0 00010000:00010000:1.0:1787864998.971949:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787864998.972166:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864998.972172:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864998.972354:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787864998.972360:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864998.972539:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea343c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087045248:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787864998.972653:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864998.979166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.979445:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea343c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087045248:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864998.982302:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332480 00000100:00100000:2.0:1787864998.982316:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332480 00000100:00100000:2.0:1787864998.982425:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:2.0:1787864998.982437:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11601:x1874712071332480:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864998.982562:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864998.982704:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11601:x1874712071332480:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 267us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.982720:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:1.0:1787864998.990769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864998.990899:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332608 00000100:00100000:2.0:1787864998.990908:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332608 00000100:00100000:2.0:1787864998.991142:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:2.0:1787864998.991152:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11601:x1874712071332608:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787864998.991225:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991242:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991253:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991267:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991274:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991281:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991303:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991311:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991318:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864998.991355:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787864998.991372:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864998.991387:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991424:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991431:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991437:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991443:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.991447:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991455:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991479:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:2.0:1787864998.991483:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.991488:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991495:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192822 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991509:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991515:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991531:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991537:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.991540:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991546:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991555:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fa206f51600) 00010000:00010000:2.0:1787864998.991557:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.991560:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991566:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192829 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991580:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991598:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991603:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991608:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864998.991610:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991626:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991635:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864998.991637:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864998.991640:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864998.991645:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864998.991733:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11601:x1874712071332608:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 582us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864998.991743:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:1.0:1787864998.998508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864998.998556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332864 00000100:00100000:0.0:1787864998.998565:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332864 00000100:00100000:0.0:1787864998.998781:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:0.0:1787864998.998798:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+60:11601:x1874712071332864:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864998.998817:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864998.998836:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192837 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.998922:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.998937:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.998949:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864998.998960:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787864998.999070:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999078:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999086:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999092:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864998.999194:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999203:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999215:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787864998.999219:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787864998.999223:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999230:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe18619283e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999271:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192837 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c4a expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999281:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:0.0:1787864998.999284:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864998.999288:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192837 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c4a expref: 62 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864998.999297:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492c00, rc 0) 00000100:00100000:0.0:1787864998.999370:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071332864:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 580us (912us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787864998.999378:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:1.0:1787864999.006699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.006864:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071332992 00000100:00100000:2.0:1787864999.006873:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071332992 00000100:00100000:2.0:1787864999.006929:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:2.0:1787864999.006939:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071332992:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864999.006989:0:8208:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864999.007201:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071332992:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 262us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.007209:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:1.0:1787864999.011116:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.011180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071333248 00000100:00100000:2.0:1787864999.011190:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071333248 00000100:00100000:2.0:1787864999.011295:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:2.0:1787864999.011305:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071333248:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864999.011324:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864999.011337:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864999.011361:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493a00/0xa63eebe1861927dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c2e expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.011381:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:2.0:1787864999.011386:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864999.011446:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619284c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c51 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864999.011885:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787864999.012091:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.012104:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.012114:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.012163:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619284c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c51 expref: 63 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.012178:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c51 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.012186:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51600) 00010000:00010000:2.0:1787864999.012189:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864999.012192:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580c00, rc 0) 00000100:00100000:2.0:1787864999.012255:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+62:11601:x1874712071333248:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 951us (1147us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787864999.012272:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:1.0:1787864999.016230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.016323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071333504 00000100:00100000:0.0:1787864999.016333:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071333504 00000100:00100000:0.0:1787864999.016414:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:0.0:1787864999.016425:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+62:11601:x1874712071333504:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787864999.016508:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864999.016537:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe186192853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c51 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016556:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51600) 00010000:00010000:0.0:1787864999.016567:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864999.016589:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016603:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016613:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016627:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016634:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016641:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016727:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016735:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016756:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016768:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864999.016772:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016780:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016789:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:0.0:1787864999.016792:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864999.016796:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016802:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492c00/0xa63eebe186192861 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016813:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016818:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016824:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016829:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864999.016832:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016837:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016868:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xca1a9a5a (ffff9fa20378bd00) 00010000:00010000:0.0:1787864999.016870:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864999.016874:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.016880:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192868 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xca1a9a5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.016964:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071333504:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 540us (750us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864999.016971:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:1.0:1787864999.020237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.022670:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071333632 00000100:00100000:2.0:1787864999.022845:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071333632 00000100:00100000:2.0:1787864999.023201:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:2.0:1787864999.023212:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+61:11601:x1874712071333632:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864999.023232:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864999.023506:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619286f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c58 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023599:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023612:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023623:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023836:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe18619286f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 63 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023854:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 62 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.023930:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:2.0:1787864999.023934:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864999.023938:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581e00, rc 0) 00000100:00100000:2.0:1787864999.024001:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+62:11601:x1874712071333632:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 792us (3774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.024015:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:1.0:1787864999.027775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.028024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071333888 00000100:00100000:2.0:1787864999.028034:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071333888 00000100:00100000:2.0:1787864999.028197:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:2.0:1787864999.028208:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+62:11601:x1874712071333888:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864999.028294:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.028311:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.028322:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864999.028666:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787864999.028676:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314968278926ns, next at 315968276607ns, rc = 0 00000004:00010000:2.0:1787864999.029343:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033dea78b reply state 0000000029d5b9ca transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.029353:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864999.029576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+64:11601:x1874712071333888:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1369us (1810us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787864999.029584:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 222 00010000:00010000:2.0:1787864999.037384:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.037434:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.037455:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:2.0:1787864999.037463:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.037486:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787864999.037492:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.037500:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.037516:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:2.0:1787864999.037520:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864999.037524:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.037531:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619287d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.037889:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334016 00000100:00100000:0.0:1787864999.037898:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334016 00000100:00100000:0.0:1787864999.037955:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:0.0:1787864999.037964:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+63:11601:x1874712071334016:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864999.037984:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864999.038109:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c5f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.038166:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.038181:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.038200:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787864999.038204:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864999.038216:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493600, rc 0) 00000100:00100000:0.0:1787864999.038276:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+64:11601:x1874712071334016:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 313us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864999.038283:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:1.0:1787864999.041720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.041862:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334144 00000100:00100000:2.0:1787864999.041871:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334144 00000100:00100000:2.0:1787864999.041983:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787864999.042004:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071334144:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787864999.042300:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2359:x1874712071334144:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 298us (587us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787864999.042309:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00080000:3.0:1787864999.042736:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864999.046512:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.046619:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334400 00000100:00100000:0.0:1787864999.046628:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334400 00000100:00100000:0.0:1787864999.046694:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787864999.046705:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+64:11601:x1874712071334400:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864999.046923:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+65:11601:x1874712071334400:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 220us (418us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787864999.046930:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787864999.049605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.050246:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334656 00000100:00100000:2.0:1787864999.050256:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334656 00000100:00100000:2.0:1787864999.050465:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:2.0:1787864999.050487:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+65:11601:x1874712071334656:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787864999.050608:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+65:11601:x1874712071334656:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 124us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.050617:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:1.0:1787864999.053719:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.053901:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334784 00000100:00100000:2.0:1787864999.053909:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334784 00000100:00100000:2.0:1787864999.053961:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:2.0:1787864999.053971:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+65:11601:x1874712071334784:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864999.053987:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864999.054007:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619288b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c66 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054088:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054102:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054113:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864999.054146:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787864999.054163:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054188:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe18619288b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c66 expref: 67 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054203:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c66 expref: 66 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.054225:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:2.0:1787864999.054228:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864999.054231:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580800, rc 0) 00000100:00100000:2.0:1787864999.054631:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+66:11601:x1874712071334784:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 660us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.054639:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:1.0:1787864999.063319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.063372:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071334912 00000100:00100000:3.0:1787864999.063382:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071334912 00000100:00100000:3.0:1787864999.063483:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787864999.063494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+10:2358:x1874712071334912:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864999.063510:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864999.063530:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c6d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864999.063555:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a7a7, blocks: 0x1 00010000:00010000:3.0:1787864999.063586:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=315s v=(0 0) 00010000:00010000:3.0:1787864999.063591:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864999.063601:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.063620:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.063633:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787864999.063691:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+11:2358:x1874712071334912:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 199us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864999.063698:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:1.0:1787864999.066895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.067307:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335168 00000100:00100000:0.0:1787864999.067316:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335168 00000100:00100000:2.0:1787864999.067726:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:2.0:1787864999.067738:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+66:11601:x1874712071335168:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787864999.067873:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+66:11601:x1874712071335168:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 138us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.067880:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:1.0:1787864999.077164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864999.077198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864999.077282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.077358:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335552 00000100:00100000:0.0:1787864999.077366:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335552 00000100:00080000:1.0:1787864999.077505:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864999.077791:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:0.0:1787864999.077803:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071335552:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787864999.077830:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335424 00000100:00100000:3.0:1787864999.077836:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335424 00000100:00100000:0.0:1787864999.077874:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2356:x1874712071335552:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 73us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864999.077881:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:3.0:1787864999.077992:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:3.0:1787864999.078003:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bd69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071335424:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864999.078166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335296 00000100:00100000:2.0:1787864999.078171:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335296 00000100:00100000:2.0:1787864999.078277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 287 00000100:00100000:2.0:1787864999.078285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071335296:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787864999.078324:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071335296:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.078331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 287 00000100:00100000:3.0:1787864999.079222:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bd69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071335424:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 48us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864999.079232:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:1.0:1787864999.083314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.086679:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335680 00000100:00100000:3.0:1787864999.086693:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335680 00000100:00100000:3.0:1787864999.086757:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787864999.086768:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+11:11601:x1874712071335680:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864999.086784:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864999.086801:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c74 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.086850:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.086860:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864999.086864:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864999.086870:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.086904:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.086917:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 12 pid: 6694 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.086931:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087045376:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864999.087090:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864999.095733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864999.095940:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335808 00000100:00100000:1.0:1787864999.095949:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335808 00010000:00010000:1.0:1787864999.095990:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 13 pid: 6694 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.096030:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787864999.096040:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2359:x1874712071335808:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864999.096055:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864999.096076:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 13 pid: 6694 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.096090:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 13 pid: 6694 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.096133:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864999.096138:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864999.096146:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.096157:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.096193:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.097166:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874712087045504:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787864999.097482:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebbf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787864999.097563:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe186192899 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c6d expref: 13 pid: 6694 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.097580:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874712087045376:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864999.097604:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.097628:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351200, rc 0) 00000100:00100000:3.0:1787864999.097668:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+12:11601:x1874712071335680:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 10902us (14362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864999.097676:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787864999.100847:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8452:1874712087045504:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787864999.100875:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864999.100929:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+11:2359:x1874712071335808:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 4890us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864999.100954:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787864999.105153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.105242:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071335936 00000100:00100000:0.0:1787864999.105252:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071335936 00002000:00100000:0.0:1787864999.105354:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9fa23b8b4780 x1874712071335936/t0(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:95/0 lens 504/0 e 0 to 0 dl 1787865010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864999.105365:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23b8b4780 with x1874712071335936 ext(0->12) 00002000:00010000:0.0:1787864999.105371:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23b8b4780 00000100:00100000:0.0:1787864999.105485:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787864999.105494:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+11:2358:x1874712071335936:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787864999.106107:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2358:x1874712071335936:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 613us (960us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787864999.106116:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00002000:00100000:0.0:1787864999.106124:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9fa23b8b4780 x1874712071335936/t4294967320(0) o4->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:95/0 lens 504/448 e 0 to 0 dl 1787865010 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864999.106133:0:6701:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23b8b4780 with x1874712071335936 ext(0->12) 00002000:00010000:0.0:1787864999.106137:0:6701:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23b8b4780 00000100:00100000:1.0:1787864999.115099:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.115202:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336064 00000100:00100000:2.0:1787864999.115211:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336064 00000100:00100000:2.0:1787864999.115362:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:2.0:1787864999.115373:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+66:11601:x1874712071336064:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787864999.159869:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787864999.159894:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787864999.159915:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa106c91f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787864999.159920:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa205316a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa106c91e40 00000020:00080000:3.0:1787864999.159923:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa205316b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa22f797400 00000020:00080000:3.0:1787864999.159962:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa23bebbd80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787864999.159965:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2059b8500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa23bebbcc0 00000020:00080000:3.0:1787864999.159968:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2059b8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa202dfec00 00000004:00080000:3.0:1787864999.159981:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787864999.160004:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787864999.160017:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787864999.160044:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787864999.160223:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787864999.160340:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087045632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864999.160418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864999.160483:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864999.160490:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087045760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787864999.160522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864999.160552:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087045632 00000100:00100000:3.0:1787864999.160558:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087045632 00000100:00100000:3.0:1787864999.160591:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087045760 00000100:00100000:3.0:1787864999.160593:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087045760 00000100:00100000:3.0:1787864999.160612:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787864999.160620:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1874712087045632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787864999.160655:0:8906:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787864999.160682:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.160706:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.160716:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787864999.160720:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864999.160724:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.160751:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.160766:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 12 pid: 6696 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.160777:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087045888:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864999.160831:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864999.160849:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787864999.160857:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1874712087045760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787864999.160969:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787864999.160973:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787864999 00002000:00010000:3.0:1787864999.160975:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787864999.160977:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787864999 -> 1787864999 00002000:00010000:3.0:1787864999.160985:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787864999.161023:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1874712087045760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (499us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787864999.161031:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787864999.161155:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa1075d4b40/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787864999.161161:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087045760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787864999.162728:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864999.162744:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087046016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787864999.162790:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864999.162842:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087046016 00000100:00100000:1.0:1787864999.162847:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087046016 00000100:00100000:1.0:1787864999.162883:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864999.162892:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1874712087046016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787864999.162914:0:6694:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1787864999.162945:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90a7a6, atime: 0x6a90a7a6, ctime: 0x6a90a7a6, blocks: 0x1 00010000:00010000:1.0:1787864999.162952:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.162979:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1787864999.162983:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864999.162990:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163005:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163014:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163022:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163040:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787864999.163850:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3316:x1874712087046016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 957us (1057us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787864999.163859:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1787864999.163884:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864999.163891:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163900:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864999.163904:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163924:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163941:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163949:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45ad9dd/0xa63eebe1861928ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.163967:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864999.163969:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864999.163970:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787864999.164702:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22f55a940/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787864999.164710:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087046016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787864999.166237:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+20:11601:x1874712071336064:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 50860us (51141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.166248:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:3.0:1787864999.168831:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087045888:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864999.168859:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.169002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.169066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.169483:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336320 00000100:00100000:3.0:1787864999.169490:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336320 00000100:00100000:3.0:1787864999.169675:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787864999.169686:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2358:x1874712071336320:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787864999.169793:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336192 00000100:00100000:0.0:1787864999.169798:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336192 00010000:00010000:0.0:1787864999.169830:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 14 pid: 6696 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.169862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:0.0:1787864999.169869:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+14:2359:x1874712071336192:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864999.169879:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864999.169896:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 14 pid: 6696 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.169910:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 14 pid: 6696 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.169931:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009282f08e/0xa63eebe186192669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bd3 expref: 14 pid: 6696 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.169947:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864999.169951:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864999.169957:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.169966:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.169988:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864999.170034:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+13:2359:x1874712071336192:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 166us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864999.170042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00010000:00010000:3.0:1787864999.170100:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.170109:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.170119:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.170137:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.170160:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864999.170969:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3317:x1874712087045632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10346us (10568us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787864999.170977:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787864999.171772:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864999.171782:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.171793:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787864999.171806:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.171825:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.171844:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.171851:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.171871:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864999.171873:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864999.171875:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787864999.173626:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa1075d7480/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787864999.173639:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087045632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864999.200136:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+12:2358:x1874712071336320:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 30443us (31059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864999.200148:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000001:00080000:1.0:1787864999.202582:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1787864999.202606:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1787864999.202624:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1787864999.202919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.202996:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336576 00000100:00100000:3.0:1787864999.203004:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336576 00000100:00100000:3.0:1787864999.203088:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:3.0:1787864999.203098:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+20:11601:x1874712071336576:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787864999.203148:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864999.203174:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c66 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.203192:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:3.0:1787864999.203196:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864999.203230:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.203244:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.203277:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864999.203626:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b0ea106 reply state 00000000a230688d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.203635:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864999.203717:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+21:11601:x1874712071336576:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 620us (801us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787864999.203724:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 228 00010000:00010000:0.0:1787864999.206595:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206611:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206618:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206624:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864999.206628:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206653:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206669:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787864999.206672:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864999.206676:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.206682:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.206792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864999.206861:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336704 00000100:00100000:1.0:1787864999.206870:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336704 00000100:00100000:1.0:1787864999.206923:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787864999.206933:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2359:x1874712071336704:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787864999.207164:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787864999.207168:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787864999 -> 1787864999 00002000:00010000:1.0:1787864999.207171:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787864998 00002000:00010000:1.0:1787864999.207173:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787864999 -> 1787864999 00002000:00010000:1.0:1787864999.207175:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787864999.208218:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071336704:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 1281us (1424us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787864999.208242:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787864999.210963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787864999.211056:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071336960 00000100:00100000:1.0:1787864999.211065:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071336960 00000100:00100000:1.0:1787864999.211141:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:1.0:1787864999.211151:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+20:11601:x1874712071336960:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787864999.211213:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.211230:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 20 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.211239:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.211356:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 20 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.211370:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 20 pid: 8208 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.211382:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087046144:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787864999.211688:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864999.215453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.215601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337088 00000100:00100000:0.0:1787864999.215611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337088 00010000:00010000:0.0:1787864999.215654:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 21 pid: 8208 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.215700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:0.0:1787864999.215710:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:2359:x1874712071337088:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864999.215726:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864999.215733:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 21 pid: 8208 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.215746:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 21 pid: 8208 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.215767:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787864999.215772:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.215799:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.215815:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.215834:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864999.215884:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:2359:x1874712071337088:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 176us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864999.215892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00010000:00010000:1.0:1787864999.216018:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581e00/0xa63eebe186192876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c58 expref: 20 pid: 8208 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.216035:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087046144:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787864999.216063:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216072:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216077:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216102:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216109:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216115:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216121:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864999.216125:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216132:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216141:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:1.0:1787864999.216144:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787864999.216147:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.216154:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336a400/0xa63eebe1861928bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.216199:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11601:x1874712071336960:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 5049us (5243us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787864999.216206:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:2.0:1787864999.220187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.220258:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337216 00000100:00100000:3.0:1787864999.220331:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337216 00000100:00100000:3.0:1787864999.220445:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787864999.220455:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071337216:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787864999.220621:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.220643:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.220651:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864999.220656:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864999.220661:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.220708:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.220722:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 8 pid: 6694 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.220737:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087046272:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864999.220820:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864999.225103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787864999.225238:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337344 00000100:00100000:0.0:1787864999.225246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337344 00010000:00010000:0.0:1787864999.225298:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 9 pid: 6694 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.225340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:0.0:1787864999.225349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071337344:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864999.225363:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864999.225385:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 9 pid: 6694 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.225686:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 9 pid: 6694 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.225711:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864999.225716:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864999.225721:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.225745:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.225931:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864999.225990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+9:2359:x1874712071337344:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 640us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864999.225999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00010000:00010000:3.0:1787864999.228951:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb805597/0xa63eebe1861928a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c74 expref: 8 pid: 6694 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.228975:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1874712087046272:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864999.229000:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229207:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229701:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229735:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229744:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229753:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229760:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787864999.229764:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229914:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229932:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.229940:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007266b45b/0xa63eebe1861928c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.230071:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071337216:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 9616us (9890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.230082:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787864999.233264:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.234128:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337600 00000100:00100000:3.0:1787864999.234137:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337600 00000100:00100000:3.0:1787864999.234195:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 230 00000100:00100000:3.0:1787864999.234205:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11601:x1874712071337600:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787864999.234284:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234300:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234328:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234555:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234567:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234575:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234604:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.234618:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 20 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.234631:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087046400:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787864999.234711:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f42300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864999.242129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.242743:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087046400:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787864999.242768:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.245202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337728 00000100:00100000:0.0:1787864999.245215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337728 00010000:00010000:0.0:1787864999.245268:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 21 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.245321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787864999.245333:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:2359:x1874712071337728:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864999.245350:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864999.245356:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 21 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245369:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 21 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245393:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493600/0xa63eebe186192884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c5f expref: 21 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245447:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787864999.245452:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245462:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245497:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.245534:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864999.245828:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.245838:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864999.246012:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787864999.246149:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787864999.246190:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787864999.246290:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874712087046528:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787864999.246350:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864999.246391:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204de6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864999.246651:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087046528 00000100:00100000:2.0:1787864999.246657:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087046528 00000100:00100000:2.0:1787864999.246702:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864999.246711:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874712087046528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787864999.246775:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874712087046528:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.246782:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864999.246926:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+23:2359:x1874712071337728:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1593us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864999.246935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787864999.248606:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787864999.248616:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787864999.248634:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa1075d4b40, transno 4294967321 00000004:00080000:3.0:1787864999.248976:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa1075d7480, transno 4294967322 00000100:00100000:3.0:1787864999.251427:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874712087046528:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787864999.253151:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787864999.253241:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874712087046656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787864999.253311:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864999.253441:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa106c91000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864999.254935:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087046656 00000100:00100000:3.0:1787864999.254946:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087046656 00000100:00100000:2.0:1787864999.255071:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864999.255081:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1874712087046656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787864999.255323:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1874712087046656:12345-0@lo:1000:mdt00_002.0 Request processed in 242us (2010us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787864999.255347:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864999.255350:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5851:1874712087046656:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787864999.255429:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255440:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255447:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255458:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864999.255463:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255483:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255499:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787864999.255503:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864999.255508:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255527:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe1861928d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255558:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255563:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255568:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255573:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787864999.255576:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255581:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255590:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787864999.255592:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864999.255598:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255624:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864999.255633:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.256732:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864999.256755:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087046784:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787864999.256835:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864999.261700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.261925:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071337856 00000100:00100000:2.0:1787864999.261933:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071337856 00000100:00100000:2.0:1787864999.261991:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787864999.262002:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11600:x1874712071337856:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:2.0:1787864999.262139:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+24:11600:x1874712071337856:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 138us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.262147:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787864999.263616:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1874712087046784:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787864999.263646:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263657:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192814 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263689:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263703:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263715:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263742:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263749:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263755:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263761:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864999.263765:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263773:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263784:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864999.263788:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864999.263792:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263799:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe1861928d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263808:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263815:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263820:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263831:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787864999.263833:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263839:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263847:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787864999.263849:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864999.263852:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864999.263857:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe1861928ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864999.264068:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+23:11601:x1874712071337600:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 29862us (30810us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787864999.264079:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 230 00000020:00080000:3.0:1787864999.264084:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787864999.265814:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864999.265823:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787864999.266250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787864999.266448:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071338112 00000100:00100000:3.0:1787864999.266456:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071338112 00000040:00080000:0.0:1787864999.266501:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787864999.266510:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864999.266581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:3.0:1787864999.266592:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+23:11600:x1874712071338112:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:2.0:1787864999.267000:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787864999.267085:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+23:11600:x1874712071338112:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 494us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.267094:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:1.0:1787864999.272691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.273183:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071338368 00000100:00100000:2.0:1787864999.273193:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071338368 00000100:00100000:2.0:1787864999.273247:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:2.0:1787864999.273257:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+23:11601:x1874712071338368:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787864999.274169:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787864999.274270:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787864999.274319:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274336:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274349:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274368:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274374:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274381:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.274425:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787864999.274454:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864999.274463:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.274486:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787864999.274490:0:8511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.274510:0:8511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.274523:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa206f51f00) 00010000:00010000:1.0:1787864999.274527:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864999.274541:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.274549:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+25:11601:x1874712071338368:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1288us (1861us total) trans 4294967514 rc 0/0 00010000:00010000:1.0:1787864999.274552:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe1861928df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.274564:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000020:00080000:2.0:1787864999.274571:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787864999.274575:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864999.274579:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864999.274581:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864999.288131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.288309:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071338496 00000100:00100000:2.0:1787864999.288318:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071338496 00000100:00100000:2.0:1787864999.288366:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:2.0:1787864999.288376:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+25:11603:x1874712071338496:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787864999.288433:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864999.288455:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861928e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c7b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288636:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288651:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288661:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288688:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288695:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.288702:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.289645:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.289660:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 26 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.289668:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.289699:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 26 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.289713:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 26 pid: 10329 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.289726:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b8b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087046912:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787864999.290360:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207dff780 going to sleep for 11 seconds 00000100:00100000:3.0:1787864999.302668:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.302731:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b8b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1874712087046912:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787864999.302758:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864999.302895:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071338752 00000100:00100000:0.0:1787864999.302902:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071338752 00000100:00100000:0.0:1787864999.302953:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:0.0:1787864999.302962:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+27:5591:x1874712071338752:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787864999.303178:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+28:5591:x1874712071338752:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 217us (518us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787864999.303187:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:1.0:1787864999.311914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787864999.312085:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071338880 00000100:00100000:2.0:1787864999.312095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071338880 00010000:00010000:2.0:1787864999.312228:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 28 pid: 10329 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864999.312305:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:2.0:1787864999.312316:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+28:2359:x1874712071338880:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864999.312331:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864999.312337:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 28 pid: 10329 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312350:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 28 pid: 10329 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192806 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c3c expref: 28 pid: 10329 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312389:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787864999.312394:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312450:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312458:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864999.312497:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864999.312558:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+27:2359:x1874712071338880:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 243us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864999.312566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00010000:00010000:1.0:1787864999.312671:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312680:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864999.312721:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787864999.312726:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787864999.312745:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312759:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312769:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312810:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312818:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312824:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864999.312829:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312836:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312846:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:1.0:1787864999.312849:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864999.312852:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312858:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe1861928ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312874:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312880:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312886:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312891:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787864999.312899:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312906:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312914:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa206f51e00) 00010000:00010000:1.0:1787864999.312917:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864999.312920:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312926:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580c00/0xa63eebe1861928f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312961:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe1861928e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c7b expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312975:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c7b expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864999.312983:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787864999.312985:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864999.312987:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580e00, rc 0) 00000100:00100000:1.0:1787864999.313012:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11603:x1874712071338496:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 24639us (24891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864999.313019:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:1.0:1787864999.419584:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087047040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864999.419653:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864999.419731:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047040 00000100:00100000:1.0:1787864999.419744:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047040 00000100:00100000:1.0:1787864999.419790:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864999.419811:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1874712087047040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864999.419831:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787864999.419871:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1874712087047040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864999.419878:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864999.419922:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087047040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787864999.996505:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787864999.999037:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787864999.999056:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:0.0:1787865000.254574:0:12504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787865000.254582:0:12504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787865000.254621:0:12504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787865000.254627:0:12504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787865000.315672:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787865000.315679:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787865000.315716:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787865000.315722:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787865000.315856:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087047168:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787865000.315948:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787865000.333936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865000.333974:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071339008 00000100:00100000:3.0:1787865000.333983:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071339008 00000100:00100000:3.0:1787865000.334046:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:3.0:1787865000.334056:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+27:11615:x1874712071339008:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787865000.334089:0:5851:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787865000.334233:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+27:11615:x1874712071339008:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865000.334241:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00080000:3.0:1787865000.334262:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865000.334434:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874712087047168:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787865000.338719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865000.338765:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071339264 00000100:00100000:2.0:1787865000.338775:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071339264 00000100:00100000:2.0:1787865000.338829:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:2.0:1787865000.338841:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+26:11615:x1874712071339264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787865000.338859:0:10329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865000.338879:0:10329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192902 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c82 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.338965:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.338986:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.338999:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865000.339011:0:10329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787865000.339836:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192902 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c82 expref: 29 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.339854:0:10329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c82 expref: 28 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.339863:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787865000.339867:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787865000.339881:0:10329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581200, rc 0) 00000100:00100000:2.0:1787865000.339942:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11615:x1874712071339264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1104us (1231us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787865000.339950:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:1.0:1787865000.355825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865000.355863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865000.355891:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071339520 00000100:00100000:1.0:1787865000.355900:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071339520 00000100:00100000:1.0:1787865000.355947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:1.0:1787865000.355956:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11615:x1874712071339520:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787865000.356025:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356041:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356052:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356264:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356273:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356279:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356286:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865000.356290:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356297:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356310:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:1.0:1787865000.356313:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787865000.356317:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865000.356323:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336b800/0xa63eebe186192917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865000.356902:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071339648 00000100:00100000:2.0:1787865000.356909:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071339648 00000100:00100000:2.0:1787865000.356950:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787865000.356959:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+30:2358:x1874712071339648:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787865000.356970:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865000.357047:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c82 expref: 30 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865000.357060:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:2.0:1787865000.357064:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787865000.357114:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ba0702c-0896-417b-a9c4-527e0244aed4+29:2358:x1874712071339648:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 156us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865000.357121:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787865000.358152:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11615:x1874712071339520:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 2192us (2331us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787865000.358162:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 235 00000040:00080000:0.0:1787865000.359320:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787865000.359326:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787865000.363534:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787865000.363549:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787865000.366726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865000.366810:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071339904 00000100:00100000:3.0:1787865000.366818:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071339904 00000100:00100000:3.0:1787865000.366896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787865000.366906:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+28:11615:x1874712071339904:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787865000.367116:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+29:11615:x1874712071339904:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 212us (399us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787865000.367124:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00010000:00010000:0.0:1787865001.019677:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865001.987733:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787865001.994111:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787865001.994188:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865001.994477:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047296 00000100:00100000:3.0:1787865001.994486:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047296 00000100:00080000:1.0:1787865001.994561:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787865001.994733:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787865001.994743:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087047296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787865001.994775:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787865001.994897:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087047296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865001.994905:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787865001.994990:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087047296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787865002.043631:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787865002.144314:0:12555:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787865002.144322:0:12555:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787865002.144365:0:12555:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787865002.144371:0:12555:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787865002.393257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865002.393333:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340160 00000100:00100000:3.0:1787865002.393341:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340160 00000100:00100000:3.0:1787865002.393435:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:3.0:1787865002.393446:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+29:11635:x1874712071340160:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787865002.393478:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865002.393497:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619291e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865002.393589:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192925 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865002.393603:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865002.393615:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787865002.393625:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787865002.393738:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351200/0xa63eebe18619291e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c89 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865002.393756:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c89 expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865002.393765:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787865002.393768:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787865002.393771:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351c00, rc 0) 00000100:00100000:3.0:1787865002.393831:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+31:11635:x1874712071340160:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 387us (592us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787865002.393853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00080000:1.0:1787865002.394111:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787865002.399080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865002.399159:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340288 00000100:00100000:0.0:1787865002.399184:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340288 00000100:00100000:0.0:1787865002.399239:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:0.0:1787865002.399354:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+31:11635:x1874712071340288:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787865002.399445:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399470:0:10329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399481:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399503:0:10329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399510:0:10329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399517:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399523:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865002.399527:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399534:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399544:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:0.0:1787865002.399548:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787865002.399552:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.399569:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865002.399637:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+31:11635:x1874712071340288:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 390us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865002.399645:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:2.0:1787865002.496625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865002.496716:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340416 00000100:00100000:0.0:1787865002.496725:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340416 00000100:00080000:1.0:1787865002.496899:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787865002.496939:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:0.0:1787865002.496950:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2358:x1874712071340416:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787865002.496968:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865002.496986:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa4b7f6c/0xa63eebe18619293a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c90 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787865002.497010:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a90a7a7, atime: 0x6a90a7a6, ctime: 0x6a90a7a7, blocks: 0xb 00010000:00010000:0.0:1787865002.497027:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1787865002.497031:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865002.497040:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4b7f6c/0xa63eebe18619293a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c90 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.497057:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa4b7f6c/0xa63eebe18619293a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c90 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865002.497069:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492000, rc 0) 00000100:00100000:0.0:1787865002.497125:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071340416:12345-192.168.206.10@tcp:101:cat.0 Request processed in 177us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865002.497149:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787865002.501696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865002.501782:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340544 00000100:00100000:1.0:1787865002.501800:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340544 00002000:00100000:1.0:1787865002.501851:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9fa23b8b5a40 x1874712071340544/t0(0) o3->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:98/0 lens 488/0 e 0 to 0 dl 1787865013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787865002.501861:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23b8b5a40 with x1874712071340544 ext(0->4095) 00002000:00010000:1.0:1787865002.501866:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23b8b5a40 00000100:00100000:1.0:1787865002.501896:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787865002.501905:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071340544:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:1.0:1787865002.502085:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2359:x1874712071340544:12345-192.168.206.10@tcp:3:cat.0 Request processed in 181us (397us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787865002.502093:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00002000:00100000:1.0:1787865002.502100:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9fa23b8b5a40 x1874712071340544/t0(0) o3->2ba0702c-0896-417b-a9c4-527e0244aed4@192.168.206.10@tcp:98/0 lens 488/4536 e 0 to 0 dl 1787865013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787865002.502108:0:6700:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa23b8b5a40 with x1874712071340544 ext(0->4095) 00002000:00010000:1.0:1787865002.502111:0:6700:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fa23b8b5a40 00010000:00010000:3.0:1787865003.067733:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787865004.027667:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787865004.027695:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087047808:0@lo:400:kworker.0 00000100:00100000:2.0:1787865004.027739:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087047936:0@lo:400:kworker.0 00000100:00100000:0.0:1787865004.027760:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865004.027779:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865004.027808:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087047552:0@lo:400:kworker.0 00000100:00100000:1.0:1787865004.027845:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865004.027867:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047936 00000100:00100000:2.0:1787865004.027875:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047936 00000100:00100000:1.0:1787865004.027875:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087048064:0@lo:400:kworker.0 00000100:00100000:1.0:1787865004.027910:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087047680:0@lo:400:kworker.0 00000100:00100000:2.0:1787865004.027929:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047552 00000100:00100000:2.0:1787865004.027933:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047552 00000100:00100000:1.0:1787865004.027937:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865004.027959:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047680 00000100:00100000:2.0:1787865004.027963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047680 00000100:00100000:1.0:1787865004.027991:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787865004.028002:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087047936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865004.028081:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874712087047936:12345-0@lo:400:kworker.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865004.028113:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787865004.028123:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f5583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865004.028130:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087047424:0@lo:400:kworker.0 00000100:00100000:2.0:1787865004.028169:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f5583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087047552:12345-0@lo:400:kworker.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865004.028177:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865004.028183:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787865004.028209:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787865004.028217:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087047680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865004.028239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047424 00000100:00100000:0.0:1787865004.028244:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047424 00000100:00100000:2.0:1787865004.028260:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087047680:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865004.028267:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787865004.028279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787865004.028288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087047424:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787865004.028290:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787865004.028323:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087047680:0@lo:400:kworker.0 00000100:00100000:0.0:1787865004.028334:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087047424:12345-0@lo:400:kworker.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865004.028341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787865004.028374:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865004.029705:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087047552:0@lo:400:kworker.0 00000100:00100000:0.0:1787865004.029739:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087047424:0@lo:400:kworker.0 00000100:00100000:3.0:1787865004.031844:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087047808 00000100:00100000:3.0:1787865004.031857:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087047808 00000100:00100000:3.0:1787865004.031938:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048064 00000100:00100000:3.0:1787865004.031941:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048064 00000100:00100000:3.0:1787865004.031961:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787865004.031969:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865004.032051:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087047808:12345-0@lo:400:kworker.0 Request processed in 82us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865004.032058:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787865004.032073:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787865004.032079:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087048064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787865004.034201:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787865004.034211:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787865004.034262:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087047808:0@lo:400:kworker.0 00000100:00100000:1.0:1787865004.034380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787865004.034461:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1874712087047936:0@lo:400:kworker.0 00000100:00100000:3.0:1787865004.037099:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087048064:12345-0@lo:400:kworker.0 Request processed in 5011us (8715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865004.037113:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787865004.037135:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787865004.037142:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa22ea3d2c0, transno 4294967307 00000004:00080000:0.0:1787865004.037162:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787865004.037181:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa22f55a940, transno 4294967310 00000100:00100000:0.0:1787865004.037188:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087048064:0@lo:400:kworker.0 00010000:00010000:0.0:1787865004.093124:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865004.193567:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865004.193615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865004.193652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865004.193674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865004.193703:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865004.193731:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341184 00000100:00100000:2.0:1787865004.193739:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341184 00000100:00100000:0.0:1787865004.193745:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340928 00000100:00100000:0.0:1787865004.193752:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340928 00000100:00100000:2.0:1787865004.193796:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340800 00000100:00100000:2.0:1787865004.193800:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340800 00000100:00100000:2.0:1787865004.193828:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:2.0:1787865004.193838:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071341184:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865004.193858:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341056 00000100:00100000:0.0:1787865004.193863:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341056 00000100:00100000:0.0:1787865004.193917:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:2.0:1787865004.193925:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:259279c0-f351-4175-bf32-3107511ab0a0+5:2358:x1874712071341184:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865004.193935:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:0.0:1787865004.193954:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071340928:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787865004.193955:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:2.0:1787865004.193964:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+31:2358:x1874712071340800:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787865004.193992:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2ba0702c-0896-417b-a9c4-527e0244aed4+31:2358:x1874712071340800:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865004.193999:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:0.0:1787865004.194026:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+8:2358:x1874712071340928:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 100us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865004.194036:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787865004.194054:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787865004.194064:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071341056:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865004.194094:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2358:x1874712071341056:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865004.194121:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00080000:2.0:1787865004.194151:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787865004.194156:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787865004.194159:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787865004.194335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071340672 00000100:00100000:1.0:1787865004.194340:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071340672 00000100:00100000:1.0:1787865004.194377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:1.0:1787865004.194384:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071340672:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865004.194464:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2358:x1874712071340672:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865004.194471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:2.0:1787865004.540953:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787865004.541023:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865004.544596:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048192 00000100:00100000:0.0:1787865004.544606:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048192 00000100:00100000:0.0:1787865004.544658:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787865004.544670:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087048192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787865004.544703:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865004.544761:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087048192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865004.544768:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787865004.548093:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087048192:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787865004.595575:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1787865004.595588:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa106c91780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787865004.595593:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa225202300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa106c919c0 00000020:00080000:2.0:1787865004.595602:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa225202a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa22f790c00 00000001:00080000:2.0:1787865004.595622:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:2.0:1787865004.595635:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787865004.595654:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787865004.595768:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787865004.596613:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787865004.606156:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787865004.606185:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1787865005.118042:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865006.140696:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787865007.101108:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787865007.101253:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865007.102242:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048320 00000100:00100000:1.0:1787865007.102252:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048320 00000100:00100000:1.0:1787865007.102318:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787865007.102329:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087048320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787865007.102366:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787865007.102466:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087048320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865007.102473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787865007.102505:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787865007.102511:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787865007.102536:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087048320:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787865007.102808:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787865007.163610:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865007.277506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865007.280063:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341312 00000100:00100000:1.0:1787865007.280076:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341312 00000100:00100000:1.0:1787865007.280159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00100000:1.0:1787865007.280172:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11289:x1874712071341312:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787865007.280279:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11289:x1874712071341312:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 110us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865007.280297:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00080000:2.0:1787865007.280545:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787865007.285897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865007.290026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341568 00000100:00100000:3.0:1787865007.290038:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341568 00000100:00100000:3.0:1787865007.290139:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787865007.290149:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+18:11289:x1874712071341568:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787865007.293324:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:11289:x1874712071341568:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 3167us (7428us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787865007.293337:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787865007.534578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865007.534822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341696 00000100:00100000:2.0:1787865007.534831:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341696 00000100:00100000:2.0:1787865007.534946:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00100000:2.0:1787865007.534956:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+5:12086:x1874712071341696:12345-192.168.206.10@tcp:101:lsof.0 00010000:00010000:2.0:1787865007.534975:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865007.534995:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7c97 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865007.535055:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865007.535068:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865007.535079:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865007.535258:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787865007.535262:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787865007.535346:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865007.535373:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c97 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787865007.535508:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787865007.535615:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c97 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865007.535626:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:2.0:1787865007.535629:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787865007.535633:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580000, rc 0) 00000100:00100000:2.0:1787865007.535769:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:259279c0-f351-4175-bf32-3107511ab0a0+6:12086:x1874712071341696:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 813us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865007.535784:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 239 00010000:00010000:3.0:1787865008.188725:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787865008.571764:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787865008.571775:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787865008.572109:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787865008.572116:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787865009.147961:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087048704:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148064:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148147:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787865009.148153:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087048576:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148176:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148196:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087049088:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148220:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087048832:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148268:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148283:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787865009.148287:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087048448:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148315:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148335:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23bc33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087048960:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.148439:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048704 00000100:00100000:3.0:1787865009.148448:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048704 00000100:00100000:3.0:1787865009.148507:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048576 00000100:00100000:3.0:1787865009.148510:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048576 00000100:00100000:3.0:1787865009.148529:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048960 00000100:00100000:3.0:1787865009.148532:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048960 00000100:00100000:3.0:1787865009.148548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787865009.148575:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148642:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087048704:12345-0@lo:400:kworker.0 Request processed in 68us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.148650:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787865009.148669:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787865009.148676:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148705:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f70bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087048576:12345-0@lo:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.148711:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787865009.148722:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787865009.148728:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148769:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087048960:12345-0@lo:400:kworker.0 Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.148775:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787865009.148819:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087048576:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148830:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087048704:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.148867:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087048960:0@lo:400:kworker.0 00000100:00100000:0.0:1787865009.149365:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049088 00000100:00100000:0.0:1787865009.149384:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049088 00000100:00100000:0.0:1787865009.149497:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048832 00000100:00100000:0.0:1787865009.149501:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048832 00000100:00100000:0.0:1787865009.149533:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787865009.149542:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865009.149594:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f709a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087049088:12345-0@lo:400:kworker.0 Request processed in 54us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865009.149601:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787865009.149614:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787865009.149620:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865009.149652:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087048832:12345-0@lo:400:kworker.0 Request processed in 33us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865009.149657:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787865009.149679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087048448 00000100:00100000:0.0:1787865009.149683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087048448 00000100:00100000:0.0:1787865009.149705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787865009.149712:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865009.149741:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087048448:12345-0@lo:400:kworker.0 Request processed in 30us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865009.149747:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787865009.149856:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23bc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087049088:0@lo:400:kworker.0 00000100:00080000:1.0:1787865009.149907:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787865009.149912:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787865009.149914:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787865009.150573:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087048448:0@lo:400:kworker.0 00000100:00100000:3.0:1787865009.150588:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b768780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087048832:0@lo:400:kworker.0 00010000:00010000:1.0:1787865009.211707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865009.315759:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865009.315808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865009.315853:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865009.315882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865009.315910:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865009.316058:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342336 00000100:00100000:3.0:1787865009.316070:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342336 00000100:00100000:3.0:1787865009.316145:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341952 00000100:00100000:3.0:1787865009.316149:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341952 00000100:00100000:3.0:1787865009.316178:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:3.0:1787865009.316207:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2356:x1874712071342336:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865009.316305:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:259279c0-f351-4175-bf32-3107511ab0a0+6:2356:x1874712071342336:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.316313:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:3.0:1787865009.316334:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:3.0:1787865009.316342:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f5592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+19:2356:x1874712071341952:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865009.316387:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f5592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+19:2356:x1874712071341952:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 46us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.316438:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:2.0:1787865009.316907:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342080 00000100:00100000:2.0:1787865009.316914:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342080 00000100:00100000:2.0:1787865009.316957:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342208 00000100:00100000:2.0:1787865009.316961:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342208 00000100:00100000:2.0:1787865009.316989:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:2.0:1787865009.316997:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071342080:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787865009.317055:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2356:x1874712071342080:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 59us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865009.317063:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:2.0:1787865009.317077:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:2.0:1787865009.317083:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071342208:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787865009.317105:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2356:x1874712071342208:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865009.317111:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:0.0:1787865009.317277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071341824 00000100:00100000:0.0:1787865009.317290:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071341824 00000100:00100000:0.0:1787865009.317331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 291 00000100:00100000:0.0:1787865009.317339:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071341824:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865009.317374:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2356:x1874712071341824:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865009.317381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 291 00000100:00080000:1.0:1787865009.317633:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787865009.317639:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787865009.317642:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787865009.660099:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787865009.660130:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23fd63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087049216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787865009.660246:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865009.660330:0:9751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049216 00000100:00100000:3.0:1787865009.660338:0:9751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049216 00000100:00100000:3.0:1787865009.660426:0:9751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787865009.660438:0:9751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087049216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787865009.660482:0:9751:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787865009.660534:0:9751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087049216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865009.660543:0:9751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787865009.660602:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23fd63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087049216:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1787865009.734581:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787865009.734627:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787865009.734641:0:5883:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1787865009.734903:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1787865010.235698:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787865010.998103:0:12760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:10:10 (1787865010) 00010000:00010000:1.0:1787865011.264247:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865012.221691:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787865012.221727:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787865012.221825:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865012.222013:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049344 00000100:00100000:1.0:1787865012.222024:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049344 00000100:00100000:1.0:1787865012.222113:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787865012.222127:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087049344:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787865012.222138:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787865012.222179:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787865012.222247:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087049344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865012.222313:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787865012.222541:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1787865012.284822:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865013.311828:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865014.269141:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087049472:0@lo:400:kworker.0 00000100:00100000:3.0:1787865014.269236:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865014.269534:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049472 00000100:00100000:1.0:1787865014.269542:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049472 00000100:00100000:1.0:1787865014.269594:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787865014.269603:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087049472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.269753:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087049856:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.269785:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865014.269819:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049856 00000100:00100000:2.0:1787865014.269823:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049856 00000100:00100000:2.0:1787865014.269860:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787865014.269867:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087049856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.269914:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087049856:12345-0@lo:400:kworker.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865014.269921:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787865014.269962:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087049856:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.269995:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087049600:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.270038:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865014.270060:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787865014.270066:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c3152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087049728:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.270088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865014.270114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049600 00000100:00100000:2.0:1787865014.270118:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049600 00000100:00100000:2.0:1787865014.270143:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049728 00000100:00100000:2.0:1787865014.270146:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049728 00000100:00100000:2.0:1787865014.270165:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787865014.270172:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23bc30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087049600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.270203:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23bc30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087049600:12345-0@lo:400:kworker.0 Request processed in 32us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865014.270209:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787865014.270220:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787865014.270227:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.270252:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087049728:12345-0@lo:400:kworker.0 Request processed in 26us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865014.270257:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787865014.270286:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c3152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087049728:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.270295:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087049600:0@lo:400:kworker.0 00000100:00080000:2.0:1787865014.270329:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787865014.270333:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787865014.277918:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087049472:12345-0@lo:400:kworker.0 Request processed in 8306us (8672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865014.277934:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787865014.278088:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087049472:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.280435:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787865014.281436:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787865014.281457:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23babd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087050112:0@lo:400:kworker.0 00000100:00100000:3.0:1787865014.281521:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865014.281661:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050112 00000100:00100000:0.0:1787865014.281668:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050112 00000100:00100000:0.0:1787865014.281738:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787865014.281752:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865014.281804:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087050112:12345-0@lo:400:kworker.0 Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865014.281812:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787865014.281971:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787865014.282001:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23babd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087050112:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.283548:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087049984:0@lo:400:kworker.0 00000100:00100000:2.0:1787865014.283609:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865014.284245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087049984 00000100:00100000:0.0:1787865014.284254:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087049984 00000100:00100000:0.0:1787865014.284329:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787865014.284340:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087049984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865014.284568:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f7e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087049984:0@lo:400:kworker.0 00000100:00080000:3.0:1787865014.284678:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865014.284784:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087049984:12345-0@lo:400:kworker.0 Request processed in 381us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865014.284793:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:1.0:1787865014.336924:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865014.440100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865014.440152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865014.440194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865014.440453:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342464 00000100:00100000:2.0:1787865014.440462:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342464 00000100:00100000:2.0:1787865014.440514:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:2.0:1787865014.440524:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071342464:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787865014.440589:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2357:x1874712071342464:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 67us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865014.440597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:3.0:1787865014.441041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865014.441076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865014.441145:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342720 00000100:00100000:0.0:1787865014.441150:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342720 00000100:00100000:0.0:1787865014.441201:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342848 00000100:00100000:0.0:1787865014.441236:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342848 00000100:00100000:0.0:1787865014.441266:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787865014.441275:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23fd61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071342720:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865014.441315:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23fd61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2357:x1874712071342720:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865014.441322:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787865014.441336:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:0.0:1787865014.441343:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071342848:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865014.441370:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2357:x1874712071342848:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865014.441376:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:1.0:1787865014.441876:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342976 00000100:00100000:1.0:1787865014.441882:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342976 00000100:00100000:1.0:1787865014.441925:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071342592 00000100:00100000:1.0:1787865014.441928:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071342592 00000100:00100000:1.0:1787865014.441949:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:1.0:1787865014.441955:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:2357:x1874712071342976:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865014.441989:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:259279c0-f351-4175-bf32-3107511ab0a0+6:2357:x1874712071342976:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 34us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865014.441994:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:1.0:1787865014.442007:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:1.0:1787865014.442012:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:2357:x1874712071342592:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865014.442035:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+18:2357:x1874712071342592:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865014.442041:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00080000:3.0:1787865014.442159:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787865014.442164:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787865014.442167:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787865014.780314:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087050240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787865014.780424:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865014.780498:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050240 00000100:00100000:3.0:1787865014.780504:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050240 00000100:00100000:3.0:1787865014.780542:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787865014.780549:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087050240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787865014.780578:0:6698:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787865014.780633:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f41e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087050240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865014.780641:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787865014.780681:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087050240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787865014.919676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865014.919765:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071343232 00000100:00100000:3.0:1787865014.919787:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071343232 00000100:00100000:3.0:1787865014.919844:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787865014.919854:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+18:12307:x1874712071343232:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:3.0:1787865014.920559:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+19:12307:x1874712071343232:12345-192.168.206.10@tcp:35:umount.0 Request processed in 703us (890us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787865014.920568:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787865014.946779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865014.946858:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071343488 00000100:00100000:2.0:1787865014.946868:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071343488 00000100:00100000:2.0:1787865014.946930:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787865014.946941:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+19:12307:x1874712071343488:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:2.0:1787865014.947308:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+20:12307:x1874712071343488:12345-192.168.206.10@tcp:35:umount.0 Request processed in 367us (536us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787865014.947317:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:1.0:1787865014.960712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865014.960835:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071343744 00000100:00100000:2.0:1787865014.960845:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071343744 00000100:00100000:2.0:1787865014.960904:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787865014.960914:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21c1c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+20:12307:x1874712071343744:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:2.0:1787865014.961937:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21c1c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ba0702c-0896-417b-a9c4-527e0244aed4+21:12307:x1874712071343744:12345-192.168.206.10@tcp:35:umount.0 Request processed in 1019us (1229us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787865014.961958:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787865014.968712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865014.970279:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344000 00000100:00100000:3.0:1787865014.970295:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344000 00000100:00100000:3.0:1787865014.970439:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787865014.970451:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+21:12307:x1874712071344000:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:3.0:1787865014.971125:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:12307:x1874712071344000:12345-192.168.206.10@tcp:35:umount.0 Request processed in 675us (2420us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787865014.971134:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:0.0:1787865014.982789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865014.982832:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865014.982867:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865014.982904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865014.982934:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344512 00000100:00100000:0.0:1787865014.982942:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344512 00000100:00100000:0.0:1787865014.982991:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:0.0:1787865014.983001:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+5:2355:x1874712071344512:12345-192.168.206.10@tcp:9:umount.0 00000100:00100000:2.0:1787865014.983108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344128 00000100:00100000:2.0:1787865014.983112:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344128 00000100:00100000:2.0:1787865014.983146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344384 00000100:00100000:2.0:1787865014.983149:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344384 00000100:00100000:2.0:1787865014.983163:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344256 00000100:00100000:2.0:1787865014.983165:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344256 00000100:00100000:2.0:1787865014.983190:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787865014.983198:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+15:2359:x1874712071344128:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787865014.983212:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865014.983230:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2b400/0xa63eebe1861919c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7822 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865014.983236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787865014.983246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+14:2359:x1874712071344384:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787865014.983248:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787865014.983254:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865014.983262:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b351e00/0xa63eebe186191bd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78ed expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865014.983269:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865014.983292:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+13:2359:x1874712071344384:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 49us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865014.983299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787865014.983317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787865014.983323:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23babd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:2359:x1874712071344256:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787865014.983455:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865014.983465:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2a800/0xa63eebe186191926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f77ea expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865014.983475:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1787865014.983664:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191c98 00000100:00080000:0.0:1787865014.983672:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9fa204dbf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787865014.983707:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787865014.987092:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:2359:x1874712071344128:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 3881us (4298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865014.987106:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00010000:00010000:1.0:1787865014.989808:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865014.992193:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23babd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2359:x1874712071344256:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 8858us (9313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865014.992208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:0.0:1787865014.994142:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ba0702c-0896-417b-a9c4-527e0244aed4+2:2355:x1874712071344512:12345-192.168.206.10@tcp:9:umount.0 Request processed in 11134us (11227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865014.994175:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:0.0:1787865015.000718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865015.002284:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071344896 00000100:00100000:2.0:1787865015.002296:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071344896 00000100:00100000:2.0:1787865015.002550:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:2.0:1787865015.002562:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2355:x1874712071344896:12345-192.168.206.10@tcp:9:umount.0 00000020:00000080:2.0:1787865015.002591:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191f00 00000020:00010000:2.0:1787865015.002598:0:6694:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa22ef94000: total 0 00000100:00080000:2.0:1787865015.002602:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9fa208000000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787865015.002641:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1787865015.002763:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa22ef94000: total 0 00010000:00010000:0.0:1787865015.002800:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa22ef94000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787865015.002849:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa4b7f6c/0xa63eebe18619293a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c90 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865015.002880:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201f6930/0xa63eebe18619229c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ac2 expref: 4 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865015.002917:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+4:2355:x1874712071344896:12345-192.168.206.10@tcp:9:umount.0 Request processed in 357us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865015.002940:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00010000:00010000:0.0:1787865015.003173:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa22ef94000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787865015.003186:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865015.003189:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865015.003190:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787865015.016896:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865015.017136:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071345920 00000100:00100000:2.0:1787865015.017145:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071345920 00000100:00100000:2.0:1787865015.017209:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 240 00000100:00100000:2.0:1787865015.017220:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+22:2355:x1874712071345920:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:2.0:1787865015.017252:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191934 00000020:00010000:2.0:1787865015.017266:0:5849:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa23b391800: total 0 00000100:00080000:2.0:1787865015.017270:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9fa23b54a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787865015.017300:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787865015.017660:0:8511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa23b391800: total 0 00010000:00010000:3.0:1787865015.017702:0:8511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa23b391800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787865015.017743:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787865015.017747:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787865015.017756:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350800/0xa63eebe186191f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f79e9 expref: 21 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017776:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20c8dc700) 00010000:00010000:3.0:1787865015.017778:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787865015.017782:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186191bfe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78fb expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017800:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787865015.017802:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787865015.017806:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030800/0xa63eebe18619231a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ae5 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017820:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa211170c00) 00010000:00010000:3.0:1787865015.017823:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787865015.017840:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350600/0xa63eebe1861925f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7bb7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017859:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa20378b100) 00010000:00010000:3.0:1787865015.017861:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787865015.017865:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa22ec2ba00/0xa63eebe186191c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7917 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017881:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787865015.017883:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787865015.017887:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe18619281b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c43 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017898:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787865015.017900:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787865015.017904:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350400/0xa63eebe18619217d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7a75 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017914:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787865015.017916:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787865015.017919:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe1861928fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c7b expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017929:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787865015.017931:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787865015.017935:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe1861922fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ade expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017946:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa211170600) 00010000:00010000:3.0:1787865015.017954:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787865015.017959:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21336ba00/0xa63eebe186191c1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7902 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017976:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787865015.017978:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787865015.017981:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200030600/0xa63eebe18619225d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7aad expref: 11 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.017991:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787865015.017994:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787865015.017997:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa200031c00/0xa63eebe186192287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7abb expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.018010:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa211170b00) 00010000:00010000:3.0:1787865015.018013:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787865015.018016:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351c00/0xa63eebe186192925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c89 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865015.018028:0:8511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa23b391800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787865015.018040:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865015.018043:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865015.018044:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865015.018868:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ba0702c-0896-417b-a9c4-527e0244aed4+7:2355:x1874712071345920:12345-192.168.206.10@tcp:39:umount.0 Request processed in 1646us (1976us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787865015.018878:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 240 00010000:00010000:2.0:1787865015.356922:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787865015.379778:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:3.0:1787865015.379786:0:7645:0:(genops.c:885:class_export_put()) final put ffff9fa204dbc800/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:0.0:1787865015.379873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa204dbc800/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-OST0001 00000020:00000080:0.0:1787865015.379979:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa204dbf800 for lustre-OST0001 00010000:00010000:0.0:1787865016.379702:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865016.724265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865016.724323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865016.724385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865016.724534:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346048 00000100:00100000:0.0:1787865016.724547:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346048 00000100:00100000:0.0:1787865016.724641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346304 00000100:00100000:0.0:1787865016.724644:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346304 00000100:00100000:0.0:1787865016.724661:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346176 00000100:00100000:0.0:1787865016.724664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346176 00000100:00100000:0.0:1787865016.724683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787865016.724695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+12:2358:x1874712071346048:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787865016.724716:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865016.724776:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b350a00/0xa63eebe186191a06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7837 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865016.724801:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865016.725231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787865016.725243:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+11:2358:x1874712071346304:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787865016.725254:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865016.725266:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2a600/0xa63eebe186191bcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f78e6 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865016.725280:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865016.725489:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+10:2358:x1874712071346048:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 795us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865016.725499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787865016.725524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787865016.725533:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+9:2358:x1874712071346176:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787865016.725543:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865016.725569:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ae00/0xa63eebe186191a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7861 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865016.725580:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865016.727086:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+8:2358:x1874712071346304:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1834us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865016.727101:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787865016.730599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+7:2358:x1874712071346176:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 5048us (6194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865016.730617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787865016.731712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865016.737553:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346560 00000100:00100000:2.0:1787865016.737574:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346560 00000100:00100000:2.0:1787865016.737672:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:2.0:1787865016.737688:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+6:2355:x1874712071346560:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:2.0:1787865016.737758:0:8208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191a1b 00000020:00010000:2.0:1787865016.737768:0:8208:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa23b397000: total 0 00000100:00080000:2.0:1787865016.737774:0:8208:0:(import.c:65:import_set_state_nolock()) ffff9fa23b394000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787865016.737800:0:8208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787865016.739117:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:259279c0-f351-4175-bf32-3107511ab0a0+5:2355:x1874712071346560:12345-192.168.206.10@tcp:39:umount.0 Request processed in 1423us (7402us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787865016.739131:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00080000:3.0:1787865016.739833:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787865016.740030:0:8511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa23b397000: total 0 00010000:00010000:3.0:1787865016.740037:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865016.740116:0:8511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa23b397000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787865016.740159:0:8511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa20c8dce00) 00010000:00010000:3.0:1787865016.740164:0:8511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787865016.740175:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580000/0xa63eebe186192948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7c97 expref: 4 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865016.740201:0:8511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa23b397000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787865016.740213:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865016.740215:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865016.740216:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865016.772596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865016.775201:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346816 00000100:00100000:1.0:1787865016.775222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346816 00000100:00100000:1.0:1787865016.775544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 294 00000100:00100000:1.0:1787865016.775558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+7:2355:x1874712071346816:12345-192.168.206.10@tcp:251:umount.0 00000020:00000080:1.0:1787865016.775623:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191911 00000020:00010000:1.0:1787865016.775634:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa203f0c800: total 0 00000100:00080000:1.0:1787865016.775640:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9fa203f0e800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787865016.775712:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa203f0c800: total 0 00010000:00010000:3.0:1787865016.775782:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa203f0c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787865016.775823:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850000/0xa63eebe1861919c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7829 expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865016.775941:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa203f0c800, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1787865016.775945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b69f8bf5-21f5-49de-a2b8-58bf41e30d6a+2:2355:x1874712071346816:12345-192.168.206.10@tcp:251:umount.0 Request processed in 389us (3363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865016.775953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 294 00010000:00010000:3.0:1787865016.775956:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865016.775957:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865016.775959:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787865016.775975:0:5844:0:(genops.c:885:class_export_put()) final put ffff9fa203f0c800/b69f8bf5-21f5-49de-a2b8-58bf41e30d6a 00000020:00000080:3.0:1787865016.776286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203f0c800/b69f8bf5-21f5-49de-a2b8-58bf41e30d6a for MGS 00000020:00000080:3.0:1787865016.776967:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa203f0e800 for MGS 00000100:00100000:3.0:1787865017.339772:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087050368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787865017.339843:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865017.342873:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050368 00000100:00100000:0.0:1787865017.342885:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050368 00000100:00100000:0.0:1787865017.342967:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787865017.342980:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087050368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787865017.343014:0:6699:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787865017.343112:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787865017.353680:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087050368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10694us (13826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865017.353695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787865017.354055:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087050368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787865017.404828:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.427503:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787865018.543866:0:12958:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787865018.552554:0:12958:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787865018.552602:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.552628:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.552635:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.552643:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.552666:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787865018.552671:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787865018.552693:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787865018.552697:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787865018.552702:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787865018.552725:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa22e469000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787865018.552782:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087050496:0@lo:39:umount.0 00000100:00100000:2.0:1787865018.552845:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787865018.552852:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865018.552861:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.552884:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865018.552888:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.552897:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865018.552910:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865018.552916:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787865018.552919:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787865018.552922:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787865018.552947:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.552954:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865018.552972:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.552979:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b351800/0xa63eebe186191996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619199d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.552995:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.552997:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.552999:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865018.553010:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087050624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865018.553044:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865018.553083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050624 00000100:00100000:3.0:1787865018.553094:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050624 00000100:00100000:3.0:1787865018.553146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787865018.553158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3318:x1874712087050624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865018.553169:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865018.553183:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a000/0xa63eebe18619199d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191996 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.553196:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865018.553230:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0743acf0-ff0b-46d8-9d09-7d582be6a838+18:3318:x1874712087050624:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865018.553238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787865018.553314:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0743acf0-ff0b-46d8-9d09-7d582be6a838:3318:1874712087050624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787865018.554117:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050496 00000100:00100000:0.0:1787865018.554124:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050496 00000100:00100000:0.0:1787865018.554178:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787865018.554185:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874712087050496:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787865018.554207:0:10329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191720 00000100:00080000:0.0:1787865018.554214:0:10329:0:(import.c:65:import_set_state_nolock()) ffff9fa23be5d000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787865018.554279:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1874712087050496:12345-0@lo:39:umount.0 Request processed in 94us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865018.554285:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787865018.554294:0:10329:0:(genops.c:885:class_export_put()) final put ffff9fa23be5f800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787865018.554546:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787865018.554574:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22e469000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787865018.554595:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087050496:0@lo:39:umount.0 00000100:00080000:3.0:1787865018.554621:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787865018.554625:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787865018.554629:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787865018.555692:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23be5f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787865018.555812:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23be5d000 for lustre-MDT0000 00010000:00010000:3.0:1787865018.557650:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.557666:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.557674:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.557683:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.558423:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865018.558437:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865018.558451:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562170:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562186:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562193:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562211:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562227:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787865018.562234:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562240:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562246:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562252:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562261:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787865018.562271:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787865018.562276:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562283:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b200 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865018.562286:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562294:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865018.562300:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865018.562312:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787865018.562315:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787865018.562317:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787865018.562351:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562357:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865018.562392:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562422:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe1861918cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861918d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562438:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865018.562441:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562447:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2ac00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865018.562450:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562456:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865018.562463:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865018.562468:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787865018.562469:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787865018.562471:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787865018.562494:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562500:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865018.562507:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562514:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2ac00/0xa63eebe186191bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865018.562526:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865018.562528:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865018.562539:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562546:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562552:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562558:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.562569:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787865018.562572:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787865018.562672:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2a000 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865018.562678:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562687:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865018.562694:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865018.562772:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787865018.562774:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787865018.562776:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787865018.562796:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562802:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865018.562818:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562824:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2a000/0xa63eebe1861919a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe1861919ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562838:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865018.562841:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562846:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336be00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865018.562856:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562863:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865018.562870:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865018.562876:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787865018.562878:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787865018.562879:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787865018.562894:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562900:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865018.562906:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562913:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe18619167f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191686 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865018.562924:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.562926:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.562928:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865018.562935:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865018.562950:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087050752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787865018.563083:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787865018.563097:0:12958:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787865018.563101:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787865018.563105:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865018.563111:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1787865018.563122:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa23b396000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865018.563127:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa23b1d5000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865018.563134:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fa23b397000 259279c0-f351-4175-bf32-3107511ab0a0 192.168.206.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865018.563139:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fa23b391800 2ba0702c-0896-417b-a9c4-527e0244aed4 192.168.206.10@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1787865018.563144:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fa22f9a3490) has exports, disconnecting them 00000020:00080000:2.0:1787865018.563148:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa23b396000), last request at 1787865014 00000020:00000080:2.0:1787865018.563156:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191893 00000100:00080000:2.0:1787865018.563172:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa23b393000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787865018.563213:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa23b396000): rc 0 00000020:00000080:2.0:1787865018.563215:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa23b396000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787865018.563226:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa23b1d5000), last request at 1787865014 00000020:00000080:2.0:1787865018.563229:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861917ba 00000100:00080000:2.0:1787865018.563234:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa23b1d1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787865018.563242:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa23b1d5000): rc 0 00000020:00000080:2.0:1787865018.563244:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa23b1d5000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787865018.563256:0:12958:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb035c1c7bae0 00000100:00080000:2.0:1787865018.563287:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787865018.563291:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787865018.563303:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787865018.563349:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787865018.563376:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787865018.563391:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa22f74e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787865018.563427:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787865018.563430:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:3.0:1787865018.563433:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1787865018.563439:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787865018.563444:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087050880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865018.563474:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865018.563513:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087051264:0@lo:9:umount.0 00000100:00100000:3.0:1787865018.563521:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087051008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865018.563557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865018.563561:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865018.563582:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787865018.563589:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087051136:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787865018.563605:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787865018.563617:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787865018.563619:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa23b54e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787865018.563643:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087051392:0@lo:9:umount.0 00010000:00010000:3.0:1787865018.563656:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865018.563669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050752 00000100:00100000:2.0:1787865018.563675:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865018.563677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050752 00000020:00080000:2.0:1787865018.563727:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fa22f9a3490) has no exports 00000100:00100000:2.0:1787865018.563762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087050880 00000100:00100000:2.0:1787865018.563765:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087050880 00000100:00100000:2.0:1787865018.563785:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051008 00000100:00100000:2.0:1787865018.563788:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051008 00000100:00100000:2.0:1787865018.563803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051136 00000100:00100000:2.0:1787865018.563806:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051136 00000100:00100000:3.0:1787865018.563835:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787865018.563842:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051264 00000100:00100000:2.0:1787865018.563843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787865018.563849:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3315:x1874712087050880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865018.563850:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051264 00000100:00100000:2.0:1787865018.563858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+21:3317:x1874712087051008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865018.563868:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865018.563869:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787865018.563886:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051392 00010000:00010000:2.0:1787865018.563890:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b350c00/0xa63eebe1861919ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe1861919a4 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865018.563891:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051392 00010000:00010000:3.0:1787865018.563892:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2be00/0xa63eebe186191bc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191bbf expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.563915:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787865018.563916:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865018.563931:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787865018.563940:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874712087051264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787865018.563964:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191807 00000100:00100000:3.0:1787865018.563965:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3315:x1874712087050880:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865018.563968:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+19:3317:x1874712087051008:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (405us total) trans 0 rc 0/0 00000100:00080000:1.0:1787865018.563973:0:8906:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd33800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787865018.563980:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787865018.563987:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787865018.564004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787865018.564011:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787865018.564016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3315:x1874712087050752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865018.564024:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+17:3317:x1874712087051136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865018.564025:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865018.564036:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865018.564038:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850400/0xa63eebe1861918d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe1861918cb expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.564048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa200030000/0xa63eebe186191686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe18619167f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865018.564061:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787865018.564092:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0743acf0-ff0b-46d8-9d09-7d582be6a838+16:3317:x1874712087051136:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865018.564098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787865018.564119:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865018.564139:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787865018.564147:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874712087051392:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787865018.564162:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe18619190a 00000100:00080000:2.0:1787865018.564168:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9fa23b395800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787865018.564182:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1787865018.564202:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000001:00000004:1.0:1787865018.564536:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787865018.564546:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3314:x1874712087051392:12345-0@lo:9:umount.0 Request processed in 399us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865018.564555:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787865018.564573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3315:x1874712087050752:12345-0@lo:103:ldlm_bl.0 Request processed in 558us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865018.564584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787865018.564606:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23b54e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787865018.564617:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787865018.564619:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787865018.564624:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22ea3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087051392:0@lo:9:umount.0 00000100:00100000:3.0:1787865018.564633:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087050880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865018.564648:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:3315:1874712087050752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865018.564674:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865018.564674:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087051136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865018.564690:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087051008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865018.564713:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3314:x1874712087051264:12345-0@lo:9:umount.0 Request processed in 773us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865018.564721:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787865018.564742:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787865018.564753:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787865018.564845:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f74e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787865018.565377:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787865018.565380:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787865018.565385:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087051264:0@lo:9:umount.0 00000020:00000080:1.0:1787865018.565538:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b396000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787865018.565590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b1d5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787865018.565628:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b393000 for lustre-MDT0000 00000020:00000080:1.0:1787865018.565633:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b1d1800 for lustre-MDT0000 00000020:00080000:3.0:1787865018.582962:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fa22f9a3490) has no exports 00000020:00000080:3.0:1787865018.643261:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916da 00000020:00000080:3.0:1787865018.643958:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa207d7a000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787865018.644024:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787865018.644122:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787865018.644189:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787865018.644193:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fa205953490) has no exports 00000020:00000080:0.0:1787865018.644677:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916d3 00000020:00000080:0.0:1787865018.644685:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa23be5a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787865018.645170:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa207d7a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787865018.645433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23be5a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787865018.645548:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787865018.645558:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787865018.645561:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22e4b8800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787865018.645564:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22e4b8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787865018.645579:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1787865019.388273:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787865019.388338:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787865019.388366:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087051648:0@lo:400:kworker.0 00000100:00100000:3.0:1787865019.388472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865019.388601:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051648 00000100:00100000:2.0:1787865019.388638:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051648 00000100:00100000:2.0:1787865019.388686:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787865019.388699:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1874712087051648:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787865019.388706:0:5849:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787865019.388748:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1874712087051648:12345-0@lo:400:kworker.0 Request processed in 55us (276us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787865019.388755:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787865019.388900:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787865019.388916:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9fa105679800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787865019.388920:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787865019.392277:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087051520:0@lo:400:kworker.0 00000100:00100000:0.0:1787865019.392356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865019.392587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051520 00000100:00100000:2.0:1787865019.392605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051520 00000100:00100000:2.0:1787865019.392652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787865019.392661:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3316:x1874712087051520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865019.392780:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0743acf0-ff0b-46d8-9d09-7d582be6a838+14:3316:x1874712087051520:12345-0@lo:400:kworker.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865019.392787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787865019.392985:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087051520:0@lo:400:kworker.0 00000100:00100000:2.0:1787865019.393642:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087051776:0@lo:400:kworker.0 00000100:00100000:2.0:1787865019.393676:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865019.393765:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051776 00000100:00100000:0.0:1787865019.393770:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051776 00000100:00100000:0.0:1787865019.393803:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787865019.393809:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874712087051776:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787865019.393815:0:8208:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:3.0:1787865019.395878:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9fa105679800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787865019.395889:0:3315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 152 00000100:00080000:3.0:1787865019.395897:0:3315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa105679800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787865019.396186:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa203edf0c0 x1874712087051904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787865019.396222:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087051648:0@lo:400:kworker.0 00000100:00100000:1.0:1787865019.396641:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712087051904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787865019.396714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865019.396893:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087051904 00000100:00100000:3.0:1787865019.396900:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087051904 00000100:00100000:3.0:1787865019.398329:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787865019.398338:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1874712087051904:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787865019.398355:0:10329:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787865019.401825:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874712087051776:12345-0@lo:400:kworker.0 Request processed in 8006us (8138us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787865019.401839:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787865019.402229:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3314:x1874712087051904:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3890us (5514us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787865019.402238:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787865019.402326:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa105679800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787865019.402332:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787865019.402336:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712087051904:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787865019.402659:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787865019.402664:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787865019.402668:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787865019.402673:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787865019.402676:0:3317:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 169 00000100:00080000:2.0:1787865019.402684:0:3317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa22f7d6000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787865019.402772:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa1075d4780 x1874712087052032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787865019.402827:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087052032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787865019.402878:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865019.402990:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087051776:0@lo:400:kworker.0 00000100:00100000:3.0:1787865019.403052:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087052032 00000100:00100000:3.0:1787865019.403058:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087052032 00000100:00100000:3.0:1787865019.403096:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787865019.403102:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874712087052032:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787865019.403117:0:5851:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787865019.403219:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874712087052032:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 115us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787865019.403226:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787865019.403270:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787865019.403275:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787865019.403278:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087052032:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1787865019.451626:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787865019.953299:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 259279c0-f351-4175-bf32-3107511ab0a0 00000001:00080000:3.0:1787865019.953315:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787865019.953319:0:5872:0:(genops.c:885:class_export_put()) final put ffff9fa23b397000/259279c0-f351-4175-bf32-3107511ab0a0 00000001:00100000:3.0:1787865019.953334:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000001:00080000:3.0:1787865019.953338:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787865019.953353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b397000/259279c0-f351-4175-bf32-3107511ab0a0 for lustre-MDT0000 00000020:00000080:3.0:1787865019.953926:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b394000 for lustre-MDT0000 00000020:00000080:2.0:1787865019.954160:0:5872:0:(genops.c:885:class_export_put()) final put ffff9fa23b391800/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:3.0:1787865019.954268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b391800/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-MDT0000 00000020:00000080:3.0:1787865019.954317:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b54a800 for lustre-MDT0000 00000001:00100000:0.0:1787865019.955561:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787865019.955567:0:6719:0:(genops.c:885:class_export_put()) final put ffff9fa23fd35800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787865019.955638:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:0.0:1787865019.955641:0:6719:0:(genops.c:885:class_export_put()) final put ffff9fa22ef94000/2ba0702c-0896-417b-a9c4-527e0244aed4 00000020:00000080:1.0:1787865019.955768:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23fd35800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787865019.955839:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23fd33800 for lustre-OST0000 00000020:00000080:1.0:1787865019.956026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22ef94000/2ba0702c-0896-417b-a9c4-527e0244aed4 for lustre-OST0000 00000020:00000080:1.0:1787865019.956052:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa208000000 for lustre-OST0000 00000001:00100000:3.0:1787865020.448285:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787865020.448583:0:7645:0:(genops.c:885:class_export_put()) final put ffff9fa23b390800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787865020.448862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b390800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787865020.448970:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b395800 for lustre-OST0001 00010000:00010000:3.0:1787865020.477364:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787865020.667683:0:12958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa22c360000 - data ffff9fa234eb1438/ffff9fa104ee3c00 00000020:01000000:0.0:1787865020.667824:0:12958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa22c380c60 - data ffff9fa227b6ae58/ffff9fa23da70c00 00000001:00000004:0.0:1787865020.676805:0:12958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787865020.752138:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787865020.752148:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787865020.752180:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787865020.752183:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787865020.752815:0:6746:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787865020.752821:0:6746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787865020.752829:0:6746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787865020.753934:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787865020.753940:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787865020.753955:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787865020.753957:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787865020.754186:0:8009:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787865020.754190:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787865020.754200:0:8009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787865020.795968:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916a2 00000020:00000080:2.0:1787865020.795980:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f9a9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787865020.796707:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916b7 00000020:00000080:2.0:1787865020.796714:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f9ab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787865020.796734:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787865020.796739:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.796747:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787865020.796751:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fa22f9a4ed8) has no exports 00000004:01000000:2.0:1787865020.797068:0:12958:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787865020.797079:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861918f5 00000020:00000080:2.0:1787865020.797083:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa203f0a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787865020.797087:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787865020.797091:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.797097:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787865020.797100:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fa22f98ced8) has no exports 00000020:00000080:2.0:1787865020.797105:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861918ee 00000020:00000080:2.0:1787865020.797109:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa23b549800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787865020.797630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9a9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787865020.797645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787865020.797649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203f0a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787865020.797654:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b549800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787865020.801140:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787865020.801149:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787865020.801154:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787865020.801162:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787865020.801165:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787865020.801256:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.801269:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787865020.801278:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191800 00000020:00000080:2.0:1787865020.801286:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa23fd31800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787865020.801724:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa23b54e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787865020.801731:0:8:0:(genops.c:885:class_export_put()) final put ffff9fa22f7d3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787865020.801734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f7d3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787865020.801741:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787865020.802004:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787865020.802010:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.802017:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787865020.802021:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fa205943490) has no exports 00000020:00000080:2.0:1787865020.802027:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861917f9 00000020:00000080:2.0:1787865020.802032:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f74a800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787865020.802375:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787865020.802378:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787865020.802382:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787865020.802386:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787865020.802415:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787865020.802445:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.802450:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787865020.802478:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.802481:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787865020.802485:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa234b10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787865020.802487:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa234b10000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787865020.802491:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787865020.802613:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916be 00000020:00000080:2.0:1787865020.802617:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f9ae000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787865020.802622:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787865020.802625:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.802628:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787865020.802631:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fa22f9a0000) has no exports 00000020:00000080:2.0:1787865020.802650:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.802653:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787865020.802655:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861916c5 00000020:00000080:2.0:1787865020.802658:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f9aa800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787865020.802668:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2100e4000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787865020.802671:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2100e4000 3 00000020:01000004:2.0:1787865020.802674:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa2100e4000 from lustre-MDT0000 00000020:00000080:2.0:1787865020.802703:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.802707:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787865020.802709:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22f9ad000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787865020.802712:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9ad000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787865020.802721:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787865020.802745:0:12958:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787865020.802749:0:12958:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787865020.802752:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787865020.802754:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.802757:0:12958:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787865020.802763:0:12958:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fa212c8a000 0743acf0-ff0b-46d8-9d09-7d582be6a838 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865020.802768:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fa205954ed8) has exports, disconnecting them 00000020:00080000:2.0:1787865020.802778:0:12958:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fa212c8a000), last request at 1787864821 00000020:00000080:2.0:1787865020.802792:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191663 00000020:00010000:2.0:1787865020.802796:0:12958:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa212c8a000: total 4 00000100:00080000:2.0:1787865020.802799:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9fa212c8d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787865020.802819:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa212c8a000): rc 0 00000020:00080000:2.0:1787865020.802823:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fa205954ed8) has no exports 00000020:00000080:3.0:1787865020.802992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23fd31800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787865020.802999:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f74a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787865020.803004:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa22f74e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787865020.803010:0:8:0:(genops.c:885:class_export_put()) final put ffff9fa22f071000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787865020.803012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f071000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787865020.803015:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787865020.803080:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9ae000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787865020.803083:0:8:0:(genops.c:885:class_export_put()) final put ffff9fa22f9ab800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787865020.803085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9ab800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787865020.803089:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787865020.803235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f9aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787865020.803363:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fa21013d200:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1787865020.803495:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fa21013ca00:5842] 1 exiting: rc = 0 00000020:00010000:1.0:1787865020.803998:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa212c8a000: total 0 00010000:00010000:1.0:1787865020.804033:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa212c8a000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787865020.804063:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ac00/0xa63eebe186191baa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191ba3 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804081:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336bc00/0xa63eebe18619198f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191988 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804093:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850200/0xa63eebe18619176d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191766 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804107:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa219850600/0xa63eebe1861919b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe1861919b2 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804117:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2a400/0xa63eebe186191bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe186191bb1 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804130:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa22ec2a200/0xa63eebe186191965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe18619195e expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804152:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336b000/0xa63eebe186191981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe18619197a expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804163:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a800/0xa63eebe186191973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa63eebe18619196c expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865020.804173:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa212c8a000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787865020.804187:0:5838:0:(genops.c:885:class_export_put()) final put ffff9fa212c8a000/0743acf0-ff0b-46d8-9d09-7d582be6a838 00010000:00010000:1.0:1787865020.804192:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865020.804194:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865020.804196:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865020.804228:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fa21013c600:5844] 2 exiting: rc = 0 00000020:00000080:3.0:1787865020.804463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa212c8a000/0743acf0-ff0b-46d8-9d09-7d582be6a838 for MGS 00000020:00000080:3.0:1787865020.804486:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa212c8d800 for MGS 00000100:00100000:2.0:1787865020.804564:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804571:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804578:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804583:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804588:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804593:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804598:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804603:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804609:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804613:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804619:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804624:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804630:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804634:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804640:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804645:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804651:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804658:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804664:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804670:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804674:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804682:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804699:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804704:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804709:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804714:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804720:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804734:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804739:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804745:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804750:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804755:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804761:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804766:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804772:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804778:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804782:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804787:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804792:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804797:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804802:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804806:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804811:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804816:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804821:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804826:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804832:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804967:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804976:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804981:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804986:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804991:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.804996:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805001:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805006:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805012:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805017:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805021:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805027:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805032:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805037:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805042:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805056:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.805061:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787865020.805473:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787865020.805477:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787865020.806644:0:12958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa203ea8ae0 - data ffff9fa234fdfbd0/ffff9fa106cd4c00 00000020:01000000:2.0:1787865020.806762:0:12958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa207471240 - data ffff9fa234c5aaf8/ffff9fa21000b800 00000020:00000080:2.0:1787865020.807309:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191647 00000020:00000080:2.0:1787865020.807316:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa207576000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787865020.807337:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2100e4000 from MGS, refs=2 00000020:01000004:2.0:1787865020.807340:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2100e4000 2 00000020:01000004:2.0:1787865020.807343:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa2100e4000 from MGS 00000020:00000080:2.0:1787865020.807382:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.807389:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787865020.807391:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa207575800/MGS 00000020:00000080:2.0:1787865020.807424:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa207575800/MGS for MGS 00000020:01000000:2.0:1787865020.807431:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787865020.807480:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787865020.807484:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865020.807489:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787865020.807495:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fa22e46a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865020.807500:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fa210db3490) has exports, disconnecting them 00000020:00080000:2.0:1787865020.807504:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fa22e46a000), last request at 1787864822 00000020:00000080:2.0:1787865020.807508:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191712 00000020:00080000:2.0:1787865020.807514:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa22e46a000): rc 0 00000020:00000080:2.0:1787865020.807518:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa22e46a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787865020.807779:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa207576000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787865020.807788:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22e46a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787865020.808233:0:12958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787865020.808238:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787865020.808241:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787865020.808246:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787865020.808451:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865020.808457:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787865020.808474:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2100e4000 1 00000020:00000080:2.0:1787865020.808478:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191639 00000020:00000080:2.0:1787865020.808483:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa207574000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787865020.808978:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa22e469000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787865020.808986:0:38:0:(genops.c:885:class_export_put()) final put ffff9fa207d7e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787865020.808989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa207d7e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787865020.808994:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1787865020.809115:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787865020.809205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa207574000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787865020.809242:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787865020.809247:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787865020.809251:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fa210db1a48) has no exports 00000020:00000080:1.0:1787865020.827702:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787865020.827715:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787865020.827720:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa2100e2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787865020.827724:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2100e2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787865020.827734:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787865020.827881:0:12958:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa2100e7800 00000020:01000000:1.0:1787865020.827905:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787865020.827909:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787865020.827913:0:12958:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787865020.827925:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fa212c90000) has no exports 00000100:00100000:1.0:1787865020.828008:0:5849:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fa20c3c4400:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787865020.830539:0:8208:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fa207dfb200:8208] 3 exiting: rc = 0 00000100:00100000:3.0:1787865020.831327:0:10329:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fa23be01e00:10329] 4 exiting: rc = 0 00000100:00100000:3.0:1787865020.831431:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fa2053d3600:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1787865020.832471:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fa2037b8000:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1787865020.832579:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832587:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832592:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832597:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832603:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832609:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832614:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832619:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832624:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832629:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832635:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832640:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832645:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832650:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832655:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832660:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832665:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832670:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832675:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832680:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832695:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832701:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832705:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832711:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832716:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832721:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832726:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832731:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832735:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832740:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832746:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832751:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832756:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832774:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832779:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832784:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832789:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832793:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832798:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832803:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832809:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832814:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832819:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832825:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832831:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832836:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832853:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832858:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832864:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832869:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832874:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832880:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832886:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832891:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832896:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832901:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832907:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832912:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832918:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832923:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832928:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832933:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832939:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.832944:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787865020.840196:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fa212c3ae00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1787865020.840311:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fa2053d3200:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1787865020.840969:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.840976:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.840982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.840988:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841011:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841016:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841023:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841030:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841039:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841045:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841050:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841056:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841063:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841068:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841073:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841080:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841085:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841090:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841095:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841099:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841104:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841109:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841114:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841120:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841125:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841129:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841134:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841139:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841144:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841148:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841154:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841158:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841163:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841168:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841173:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841178:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841183:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841192:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841205:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841215:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841220:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841224:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841229:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841234:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841239:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841243:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841248:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841253:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841262:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841267:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841278:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841284:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841289:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841294:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841300:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841305:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841310:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841315:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841320:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841325:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.841331:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.844011:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fa212c42200:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1787865020.844264:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fa212c43e00:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1787865020.844787:0:11973:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9fa22ea94a00:11973] 2 exiting: rc = 0 00000100:00100000:1.0:1787865020.844955:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844964:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844970:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844976:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844987:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.844994:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845001:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845007:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845024:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845029:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845036:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845054:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845060:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845066:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845071:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845079:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845084:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845091:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845097:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845104:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845110:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845115:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845121:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845322:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845335:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845341:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845346:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845361:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845367:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845374:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845381:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845387:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845392:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845670:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845677:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845782:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845789:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845798:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845804:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845810:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845815:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845821:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845831:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845897:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845903:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845909:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845915:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845936:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845943:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845949:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845955:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845961:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845966:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845972:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845978:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845983:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845988:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.845995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.846191:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.846225:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.846237:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.846244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.846253:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787865020.861611:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fa212c42a00:5856] 0 exiting: rc = 1 00000100:00100000:1.0:1787865020.862389:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fa212c42600:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1787865020.862485:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862492:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862497:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862501:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862506:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862511:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862515:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862519:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862524:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862529:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862534:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862538:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862542:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862547:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862566:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862571:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862576:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862581:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862586:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862590:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862595:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862600:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862604:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862609:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862613:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862618:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862622:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862626:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862643:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862648:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862653:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862657:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862661:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862667:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862672:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862677:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862681:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862686:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862691:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862695:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862700:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862704:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862709:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862713:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862718:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862723:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862729:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862733:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862738:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862752:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862756:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862761:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862765:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862769:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862774:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862778:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862782:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862787:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862792:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862796:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862801:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862805:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862810:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.862815:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863149:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fa212c3b200:5859] 1 exiting: rc = 0 00000100:00100000:3.0:1787865020.863674:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fa212c43c00:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1787865020.863813:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863819:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863824:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863829:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863834:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863840:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863844:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863849:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863853:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863858:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863864:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863869:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863874:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863879:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863884:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863889:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863894:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863899:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863904:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863921:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863926:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863931:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863936:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863941:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863945:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863950:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863955:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863960:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863965:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863970:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863976:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863981:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.863986:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864224:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864229:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864235:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864239:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864249:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864254:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864263:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864267:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864271:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864275:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864279:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864284:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864288:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864292:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864297:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864303:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864308:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864314:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864318:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864334:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864343:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864348:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864367:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864372:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864378:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864383:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864387:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864394:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.864417:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865020.864852:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fa212c3a600:5860] 0 exiting: rc = 1 00000100:00100000:3.0:1787865020.865118:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fa212c3a000:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1787865020.865154:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865161:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865166:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865171:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865176:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865180:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865185:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865190:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865194:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865200:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865205:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865214:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865218:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865223:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865227:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865231:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865236:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865240:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865249:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865253:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865262:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865266:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865278:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865282:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865287:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865291:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865295:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865300:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865304:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865309:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865313:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865317:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865321:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865325:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865329:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865335:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865344:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865362:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865367:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865372:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865377:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865383:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865387:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865392:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865413:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865419:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865432:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865437:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865442:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865447:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865452:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865456:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865461:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865466:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865470:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865474:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865478:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865490:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865496:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865502:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.865506:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.866123:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fa212c3b000:5864] 2 exiting: rc = 0 00000100:00100000:2.0:1787865020.866698:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fa212c3a400:5863] 1 exiting: rc = 0 00000100:00100000:3.0:1787865020.866930:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fa212c3ba00:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1787865020.867144:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867150:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867156:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867161:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867166:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867172:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867177:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867182:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867191:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867196:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867201:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867206:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867221:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867226:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867230:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867235:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867250:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867255:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867263:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867267:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867272:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867277:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867282:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867291:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867299:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867305:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867311:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867326:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867331:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867337:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867342:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867347:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867363:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867368:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867374:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867379:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867383:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867387:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867392:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867413:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867499:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867506:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867511:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867516:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867521:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867525:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867530:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867535:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867540:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867546:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867551:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867555:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867561:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867566:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867572:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867577:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867582:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867587:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867591:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867596:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865020.867602:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787865020.875311:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787865020.875332:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787865020.875337:0:12958:0:(genops.c:885:class_export_put()) final put ffff9fa202a12800/MDS_uuid 00000020:00000080:1.0:1787865020.875341:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa202a12800/MDS_uuid for MDS 00000020:01000000:1.0:1787865020.875347:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787865020.876483:0:12958:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787865021.499924:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865022.524365:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787865023.474295:0:13113:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787865023.495994:0:13113:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787865023.496047:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.496062:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.496070:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.496078:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.496101:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787865023.496107:0:13113:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787865023.496144:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787865023.496150:0:13113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787865023.496157:0:13113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787865023.496163:0:13113:0:(import.c:65:import_set_state_nolock()) ffff9fa105679800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787865023.496168:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787865023.496170:0:13113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787865023.496173:0:13113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787865023.497073:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497084:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497091:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497097:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497117:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787865023.497134:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787865023.497139:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497146:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b000 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865023.497149:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497157:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865023.497165:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865023.497171:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787865023.497174:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787865023.497176:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787865023.497208:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497224:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865023.497246:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497252:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b000/0xa63eebe18619197a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191981 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497265:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865023.497268:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497273:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219851800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865023.497275:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497281:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865023.497287:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865023.497292:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787865023.497293:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787865023.497304:0:8511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497309:0:8511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865023.497344:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497361:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851800/0xa63eebe186191988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe18619198f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865023.497373:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865023.497375:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865023.497376:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865023.497386:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787865023.497425:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087052160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865023.497491:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865023.497556:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087052160 00000100:00100000:2.0:1787865023.497562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087052160 00000100:00100000:2.0:1787865023.497597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787865023.497605:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3317:x1874712087052160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787865023.497611:0:5834:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787865023 with bad export cookie 11979271412702058083 00010000:00010000:1.0:1787865023.497877:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865023.497909:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787865023.497920:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087052288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865023.497950:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865023.497977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087052288 00000100:00100000:1.0:1787865023.497981:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087052288 00000100:00100000:1.0:1787865023.498000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787865023.498005:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1874712087052288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787865023.498010:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787865023 with bad export cookie 11979271412702058083 00000100:00100000:1.0:1787865023.498051:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3316:x1874712087052288:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (100us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787865023.498058:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787865023.498091:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787865023.498094:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9fa2052d9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787865023.498098:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787865023.499476:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499492:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499499:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499506:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499526:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787865023.499532:0:13113:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787865023.499537:0:13113:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787865023.499564:0:13113:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787865023.499582:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1787865023.499592:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865023.499598:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499605:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865023.499608:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.499616:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865023.499623:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865023.499628:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787865023.499631:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787865023.499632:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1787865023.510176:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.110@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787865023.510181:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787865023.510190:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa1075d4000 x1874712087052160/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787865039 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865023.510294:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa1075d6d00 x1874712087052288/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787865039 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787865023.510305:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787865023.510308:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787865023.510327:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787865023.513551:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0743acf0-ff0b-46d8-9d09-7d582be6a838:3317:1874712087052160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865023.513640:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.513651:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865023.513676:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.513684:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b600/0xa63eebe186191bb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa63eebe186191bb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865023.513701:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865023.513704:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865023.513706:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865023.513719:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787865023.513748:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0743acf0-ff0b-46d8-9d09-7d582be6a838:0:1874712087052416:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787865023.513773:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787865023.513795:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787865023.513800:0:13113:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fa205950000) has no exports 00000020:00080000:3.0:1787865023.513992:0:13113:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fa205950000) has no exports 00000020:01000000:3.0:1787865023.515686:0:13113:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa212017780 - data ffff9fa23feeb798/ffff9fa1054ba800 00000020:01000000:3.0:1787865023.515853:0:13113:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa2048a2900 - data ffff9fa2279f8d80/ffff9fa1071ad400 00000100:00080000:1.0:1787865023.516268:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9fa2052d9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787865023.516278:0:3316:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 137 00000100:00080000:1.0:1787865023.516287:0:3316:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff9fa2052d9000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787865023.516320:0:3316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f558b40 x1874712087052544/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787865023.516373:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0743acf0-ff0b-46d8-9d09-7d582be6a838:3314:1874712087052544:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787865023.516442:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874712087052544 offset 0 length 520: 4 00000100:00100000:1.0:1787865023.516495:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0743acf0-ff0b-46d8-9d09-7d582be6a838:3316:1874712087052288:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1787865023.517490:0:5834:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874712087052160 offset 224 length 224: 4 00000100:00100000:2.0:1787865023.517507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3317:x1874712087052160:12345-0@lo:103:ldlm_bl.0 Request processed in 19902us (20015us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787865023.517517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:1.0:1787865023.532148:0:13113:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:3.0:1787865023.547518:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787865023.575009:0:13113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191789 00000020:00000080:0.0:1787865023.575017:0:13113:0:(genops.c:885:class_export_put()) final put ffff9fa23b1d3000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787865023.575038:0:13113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa23be5b800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787865023.575041:0:13113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa23be5b800 2 00000020:01000004:0.0:1787865023.575045:0:13113:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa23be5b800 from lustre-OST0000 00000020:00000080:0.0:1787865023.575067:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787865023.575077:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787865023.575079:0:13113:0:(genops.c:885:class_export_put()) final put ffff9fa22ed6d000/lustre-OST0000_UUID 00000020:00000080:0.0:1787865023.575082:0:13113:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22ed6d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787865023.575093:0:13113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787865023.575133:0:13113:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787865023.575137:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787865023.575141:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787865023.575145:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787865023.575153:0:13113:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fa10567c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787865023.575171:0:13113:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9fa22f9a1a48) has exports, disconnecting them 00000020:00080000:0.0:1787865023.575176:0:13113:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fa10567c800), last request at 1787864836 00000020:00000080:0.0:1787865023.575180:0:13113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe1861917b3 00000020:00080000:0.0:1787865023.575189:0:13113:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa10567c800): rc 0 00000020:00000080:0.0:1787865023.575194:0:13113:0:(genops.c:885:class_export_put()) final put ffff9fa10567c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787865023.575878:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b1d3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787865023.575891:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa10567c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787865023.584882:0:13113:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787865023.584891:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787865023.584894:0:13113:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787865023.584901:0:13113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787865023.585127:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787865023.585137:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787865023.585144:0:13113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa23be5b800 1 00000020:00000080:0.0:1787865023.585150:0:13113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191743 00000020:00000080:0.0:1787865023.585158:0:13113:0:(genops.c:885:class_export_put()) final put ffff9fa22f074000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787865023.585164:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787865023.585168:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787865023.585172:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787865023.585176:0:13113:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fa212c91a48) has no exports 00000020:00000080:2.0:1787865023.585263:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa105679800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787865023.585270:0:38:0:(genops.c:885:class_export_put()) final put ffff9fa210d06000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787865023.585273:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa210d06000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787865023.585278:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787865023.585333:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f074000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787865023.595606:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865023.595634:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787865023.595639:0:13113:0:(genops.c:885:class_export_put()) final put ffff9fa23be59800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787865023.595644:0:13113:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23be59800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787865023.595651:0:13113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787865023.595795:0:13113:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa23be5f000 00000020:02000400:2.0:1787865023.595838:0:13113:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1787865024.507755:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0743acf0-ff0b-46d8-9d09-7d582be6a838->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787865024.507767:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0743acf0-ff0b-46d8-9d09-7d582be6a838->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787865024.507771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787865024.507774:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787865024.507778:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787865024.507787:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 335 00000100:00080000:1.0:1787865024.507792:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787865024.507799:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa22f7d6000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787865024.507837:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f559a40 x1874712087052672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787865024.512361:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087052672:0@lo:38:kworker.0 00000400:00000100:0.0:1787865024.512475:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874712087052672 offset 0 length 520: 4 00010000:00010000:1.0:1787865024.571710:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865025.595492:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787865026.159104:0:13266:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787865026.167435:0:13266:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787865026.167508:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.167523:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.167540:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.167548:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.167566:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787865026.167571:0:13266:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787865026.167593:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787865026.167604:0:13266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa22f559a40 x1874712087052672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787865039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865026.167624:0:13266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787865026.167629:0:13266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787865026.167635:0:13266:0:(import.c:65:import_set_state_nolock()) ffff9fa22f7d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787865026.167640:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787865026.167643:0:13266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa22f559a40 x1874712087052672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787865039 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865026.167650:0:13266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787865026.167653:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1787865026.167712:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865026.167720:0:8511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865026.167728:0:8511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350e00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865026.167732:0:8511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865026.167740:0:8511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865026.167748:0:8511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865026.167753:0:8511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787865026.167756:0:8511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787865026.167759:0:8511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787865026.167774:0:8511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2052d9000 00010000:00010000:2.0:1787865026.167779:0:8511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865026.167785:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa23b350e00/0xa63eebe18619195e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191965 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865026.167800:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865026.167808:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865026.167812:0:8511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787865026.167984:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087052672:0@lo:38:kworker.0 00010000:00010000:1.0:1787865026.169825:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.169949:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.169957:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.169979:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.170037:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865026.170046:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.170053:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.170058:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865026.170065:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170183:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787865026.170190:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170198:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa219850800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:0.0:1787865026.170201:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170219:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787865026.170226:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787865026.170231:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787865026.170234:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787865026.170243:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2052d9000 00010000:00010000:0.0:1787865026.170246:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219850800/0xa63eebe18619196c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191973 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170265:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787865026.170268:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170282:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa22ec2b800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:0.0:1787865026.170285:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170292:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787865026.170298:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787865026.170313:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787865026.170315:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787865026.170329:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2052d9000 00010000:00010000:0.0:1787865026.170333:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865026.170340:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865026.170342:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865026.170345:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865026.170607:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787865026.170613:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2b800/0xa63eebe186191ba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe186191baa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865026.170627:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787865026.170631:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787865026.170633:0:13266:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787865026.170654:0:13266:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787865026.170658:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787865026.170672:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787865026.170678:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787865026.170681:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fa205940000) has no exports 00000020:00080000:1.0:1787865026.170951:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fa205940000) has no exports 00010000:00010000:0.0:1787865026.171345:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787865026.173132:0:13266:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa212017240 - data ffff9fa23feeb948/ffff9fa104f41800 00000020:01000000:1.0:1787865026.173579:0:13266:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9fa22f0af780 - data ffff9fa1052bf0d8/ffff9fa22f7b5c00 00100000:10000000:1.0:1787865026.189175:0:13266:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787865026.246552:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191862 00000020:00000080:2.0:1787865026.246563:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa203f0c000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787865026.246742:0:13266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa105678000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787865026.246746:0:13266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa105678000 2 00000020:01000004:2.0:1787865026.246750:0:13266:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa105678000 from lustre-OST0001 00000020:00000080:2.0:1787865026.246770:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865026.246780:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787865026.246783:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa203f09000/lustre-OST0001_UUID 00000020:00000080:2.0:1787865026.246786:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203f09000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787865026.246792:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787865026.247006:0:13266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0743acf0-ff0b-46d8-9d09-7d582be6a838->MGS 00010000:00010000:2.0:1787865026.247021:0:13266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa219851000/0xa63eebe186191766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865026.247031:0:13266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa219851000/0xa63eebe186191766 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865026.247038:0:13266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787865026.247040:0:13266:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787865026.247044:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787865026.247057:0:13266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2052d9000 00010000:00010000:2.0:1787865026.247061:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa219851000/0xa63eebe186191766 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe18619176d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865026.247076:0:13266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865026.247082:0:13266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865026.247101:0:13266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787865026.247103:0:13266:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787865026.247105:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787865026.247116:0:13266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2052d9000 00010000:00010000:2.0:1787865026.247119:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa22ec2bc00/0xa63eebe1861919b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa63eebe1861919b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787865026.247136:0:13266:0:(import.c:65:import_set_state_nolock()) ffff9fa2052d9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787865026.247140:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787865026.247143:0:13266:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787865026.247144:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787865026.247148:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787865026.247158:0:13266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa22f558b40 x1874712087052544/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787865033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787865026.247178:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787865026.247180:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787865026.247244:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0743acf0-ff0b-46d8-9d09-7d582be6a838:3314:1874712087052544:0@lo:250:ptlrpcd_00_01.0 00000020:00000080:1.0:1787865026.247416:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa203f0c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1787865026.247468:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787865026.247474:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191655 00000020:00000080:2.0:1787865026.247479:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa202a13800/0743acf0-ff0b-46d8-9d09-7d582be6a838 00000020:01000000:2.0:1787865026.247494:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.110@tcp (flags='') 00000020:00000080:2.0:1787865026.247500:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865026.247505:0:13266:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787865026.247509:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fa210db4ed8) has no exports 00000020:00000080:1.0:1787865026.247830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa202a13800/0743acf0-ff0b-46d8-9d09-7d582be6a838 for MGC192.168.206.110@tcp 10000000:01000000:0.0:1787865026.247910:0:5846:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787865026.247989:0:13266:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.110@tcp: client import never connected 00000100:00080000:2.0:1787865026.247993:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787865026.247995:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787865026.247997:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787865026.247999:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787865026.248045:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865026.248050:0:13266:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.110@tcp (uuid 0743acf0-ff0b-46d8-9d09-7d582be6a838) 00000020:01000000:2.0:1787865026.248055:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787865026.248067:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865026.248071:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787865026.248075:0:13266:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fa23b392800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787865026.248080:0:13266:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9fa205951a48) has exports, disconnecting them 00000020:00080000:2.0:1787865026.248084:0:13266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fa23b392800), last request at 1787864853 00000020:00000080:2.0:1787865026.248088:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe18619188c 00000020:00080000:2.0:1787865026.248100:0:13266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa23b392800): rc 0 00000020:00000080:2.0:1787865026.248103:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa23b392800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787865026.248336:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2052d9000 for MGC192.168.206.110@tcp 00000020:00000080:1.0:1787865026.248342:0:8:0:(genops.c:885:class_export_put()) final put ffff9fa2052da000/0743acf0-ff0b-46d8-9d09-7d582be6a838 00000020:00000080:1.0:1787865026.248344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2052da000/0743acf0-ff0b-46d8-9d09-7d582be6a838 for MGC192.168.206.110@tcp 00000020:01000000:1.0:1787865026.248350:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.110@tcp (0743acf0-ff0b-46d8-9d09-7d582be6a838) 00000020:00000080:1.0:1787865026.248739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa23b392800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787865026.260985:0:13266:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787865026.260992:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787865026.260997:0:13266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787865026.261004:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787865026.261141:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa22f7d6000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787865026.261376:0:8511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787865026.261864:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787865026.262109:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787865026.262279:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fa22523f200:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1787865026.262429:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fa22523e600:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1787865026.262520:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.262767:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fa22523e000:5834] 0 exiting: rc = 1 00000100:00100000:1.0:1787865026.262910:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fa2037b7200:5836] 2 exiting: rc = 0 00000100:00100000:0.0:1787865026.263081:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fa22523e800:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1787865026.263130:0:8452:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fa23baa5200:8452] 3 exiting: rc = 0 00000100:00100000:1.0:1787865026.263220:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263227:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263232:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263237:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263242:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263247:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263253:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263258:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263263:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263269:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263273:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263280:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263286:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263292:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263297:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263303:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263311:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263338:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263343:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263348:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263354:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263359:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263364:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263369:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263374:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263378:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263383:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263422:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263429:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263434:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263438:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263442:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263447:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263452:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263457:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263462:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263467:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263472:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263476:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263480:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263485:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263489:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263493:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263498:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263502:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263507:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263512:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263516:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263521:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263527:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263532:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263536:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263549:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263554:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263559:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263564:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263569:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263574:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263592:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263597:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263602:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263606:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263611:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.263615:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787865026.264844:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787865026.264855:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787865026.264860:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa22f7d7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787865026.264864:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f7d7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787865026.264869:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787865026.264908:0:13266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa105678000 1 00000020:00000080:1.0:1787865026.264914:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa63eebe186191831 00000020:00000080:1.0:1787865026.264920:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa22f74b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787865026.264970:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787865026.264976:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787865026.264981:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787865026.264983:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fa23b673490) has no exports 00000020:00000080:0.0:1787865026.269240:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f74b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787865026.278316:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865026.278341:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787865026.278347:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa22ed6a000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787865026.278351:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22ed6a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787865026.278365:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787865026.278570:0:13266:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa10567c000 00000020:01000000:2.0:1787865026.278777:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787865026.278783:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787865026.278787:0:13266:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787865026.278791:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fa210db0000) has no exports 00000020:00000080:2.0:1787865026.278822:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787865026.278827:0:13266:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787865026.278830:0:13266:0:(genops.c:885:class_export_put()) final put ffff9fa22f076800/OSS_uuid 00000020:00000080:2.0:1787865026.278833:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa22f076800/OSS_uuid for OSS 00000020:01000000:2.0:1787865026.278836:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787865026.278912:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fa210163c00:6695] 1 exiting: rc = 0 00000100:00080000:1.0:1787865026.279018:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787865026.279116:0:8906:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fa22ef84000:8906] 3 exiting: rc = 0 00000100:00100000:1.0:1787865026.279177:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fa210c0f000:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1787865026.279296:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fa210162c00:6696] 2 exiting: rc = 0 00000100:00100000:2.0:1787865026.279716:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279735:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279740:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279745:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279750:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279755:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279759:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279764:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279769:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279774:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279781:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279788:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279793:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279798:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279803:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279808:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279813:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279819:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279825:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279830:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279836:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279840:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279845:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279851:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279856:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279861:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279866:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279872:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279877:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279882:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279887:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279892:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279897:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279901:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279906:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279912:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279925:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279930:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279934:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279939:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279944:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279948:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279953:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279958:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279963:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279970:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279974:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279980:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279984:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279989:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.279996:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280001:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280006:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280010:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280015:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280020:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280025:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280031:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280036:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280041:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280046:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280052:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280056:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280062:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.280818:0:9751:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fa203fc9400:9751] 2 exiting: rc = 0 00000100:00100000:1.0:1787865026.281117:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fa206fa8a00:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1787865026.281540:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fa206fa9800:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1787865026.281693:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281701:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281706:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281710:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281715:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281729:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281734:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281739:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281744:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281748:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281753:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281757:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281762:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281767:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281771:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281775:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281780:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281785:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281789:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281794:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281799:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281803:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281808:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281812:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281818:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281823:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281827:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281831:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281836:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281841:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281846:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281850:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281855:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281860:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281864:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281868:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281873:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281877:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281881:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281886:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281898:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281903:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281908:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281913:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281918:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281923:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281928:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281933:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281938:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281943:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281948:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281953:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281958:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281963:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281968:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281973:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281978:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281983:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281988:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281993:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.281998:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.282003:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.282007:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.282011:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283025:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fa206fa9200:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1787865026.283369:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fa206fa9e00:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1787865026.283781:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fa206fa8800:6702] 2 exiting: rc = 0 00000100:00100000:1.0:1787865026.283953:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283960:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283965:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283971:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283976:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283981:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283987:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283993:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.283998:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284002:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284022:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284027:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284034:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284043:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284052:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284060:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284068:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284076:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284082:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284087:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284092:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284097:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284102:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284119:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284125:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284130:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284135:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284140:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284146:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284151:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284156:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284162:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284167:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284172:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284177:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284182:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284188:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284194:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284199:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284205:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284210:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284215:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284221:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284226:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284231:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284245:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284264:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284270:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284284:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284303:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284310:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284315:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284330:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284336:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284342:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284348:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284356:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284362:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284367:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284372:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284377:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284383:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284392:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.284424:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.293613:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fa206fa9c00:6703] 0 exiting: rc = 1 00000100:00100000:3.0:1787865026.293877:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fa206fa8000:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1787865026.294024:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294032:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294036:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294042:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294047:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294052:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294057:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294062:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294066:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294071:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294076:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294086:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294093:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294098:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294103:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294107:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294124:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294128:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294133:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294137:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294142:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294146:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294150:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294155:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294159:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294164:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294168:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294173:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294199:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294206:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294211:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294215:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294220:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294224:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294229:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294234:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294239:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294244:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294249:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294253:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294257:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294261:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294266:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294271:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294276:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294281:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294285:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294289:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294294:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294298:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294303:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294315:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294329:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294335:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294340:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294344:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294349:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294354:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294359:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294364:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294369:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294374:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294379:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.294391:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787865026.297862:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fa23f99a200:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1787865026.298162:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fa23f99b200:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1787865026.298228:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298236:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298242:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298248:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298253:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298260:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298266:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298271:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298277:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298283:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298289:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298295:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298300:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298332:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298342:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298346:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298352:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298358:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298363:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298369:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298374:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298388:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298393:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298427:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298432:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298452:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298459:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298465:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298471:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298476:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298481:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298487:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298493:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298498:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298503:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298508:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298513:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298538:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298545:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298551:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298557:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298564:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298569:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298575:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298793:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298800:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298805:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298812:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298818:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298842:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298850:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298857:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298912:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298918:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298924:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298931:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298946:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298952:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298957:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298963:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298970:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298977:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298983:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787865026.298996:0:13266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787865026.308040:0:13266:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787865043.183696:0:13878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787865051.166732:0:14354:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787865051.166738:0:14354:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787865051.166906:0:14354:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa105f5d800 00000020:01000004:0.0:1787865051.166921:0:14354:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787865051.166929:0:14354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787865051.166941:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fa22f98b490) 00000020:00000080:0.0:1787865051.166954:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787865051.186257:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787865051.189089:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787865051.189841:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1787865051.189940:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1787865051.190097:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1787865051.190209:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1787865051.190307:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1787865051.190523:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787865051.190595:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1787865051.190843:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1787865051.191873:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 281: rc = 0 00100000:10000000:1.0:1787865051.191981:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 281: rc = 0 00100000:10000000:1.0:1787865051.196901:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 255: rc = 0 00100000:10000000:1.0:1787865051.197178:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 255: rc = 0 00100000:10000000:1.0:1787865051.198452:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.199239:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.199605:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.199950:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 255: rc = 0 00100000:10000000:1.0:1787865051.200219:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 255: rc = 0 00100000:10000000:1.0:1787865051.201872:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.202146:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.203275:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 255: rc = 0 00100000:10000000:1.0:1787865051.204380:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 255: rc = 0 00100000:10000000:1.0:1787865051.204956:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 255: rc = 0 00100000:10000000:1.0:1787865051.205879:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 769: rc = 0 00100000:10000000:1.0:1787865051.206237:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 769: rc = 0 00100000:10000000:1.0:1787865051.206971:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 769: rc = 0 00100000:10000000:1.0:1787865051.207311:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 769: rc = 0 00100000:10000000:1.0:1787865051.207994:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 769: rc = 0 00100000:10000000:1.0:1787865051.208507:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 769: rc = 0 00100000:10000000:1.0:1787865051.208898:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 769: rc = 0 00100000:10000000:1.0:1787865051.209372:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 769: rc = 0 00100000:10000000:1.0:1787865051.209842:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 769: rc = 0 00100000:10000000:1.0:1787865051.210241:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 769: rc = 0 00100000:10000000:1.0:1787865051.210520:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 769: rc = 0 00100000:10000000:1.0:1787865051.210911:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 769: rc = 0 00100000:10000000:1.0:1787865051.211289:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 769: rc = 0 00100000:10000000:1.0:1787865051.211728:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 769: rc = 0 00100000:10000000:1.0:1787865051.212183:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 769: rc = 0 00100000:10000000:1.0:1787865051.212470:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 769: rc = 0 00100000:10000000:1.0:1787865051.212808:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 769: rc = 0 00100000:10000000:1.0:1787865051.213152:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 769: rc = 0 00100000:10000000:0.0:1787865051.213800:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 769: rc = 0 00100000:10000000:0.0:1787865051.214052:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 769: rc = 0 00100000:10000000:0.0:1787865051.214279:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 769: rc = 0 00100000:10000000:0.0:1787865051.214524:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 769: rc = 0 00100000:10000000:0.0:1787865051.214818:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 769: rc = 0 00100000:10000000:0.0:1787865051.215036:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 769: rc = 0 00100000:10000000:0.0:1787865051.215262:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 769: rc = 0 00100000:10000000:0.0:1787865051.215529:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 769: rc = 0 00100000:10000000:0.0:1787865051.215773:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 769: rc = 0 00100000:10000000:0.0:1787865051.215975:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 769: rc = 0 00100000:10000000:0.0:1787865051.216210:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 769: rc = 0 00100000:10000000:0.0:1787865051.216893:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 769: rc = 0 00100000:10000000:0.0:1787865051.217139:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 769: rc = 0 00100000:10000000:0.0:1787865051.217497:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 769: rc = 0 00100000:10000000:0.0:1787865051.218904:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 653: rc = 0 00100000:10000000:0.0:1787865051.219612:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787865051.219802:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 282: rc = 0 00100000:10000000:0.0:1787865051.219999:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787865051.220079:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 282: rc = 0 00100000:10000000:0.0:1787865051.220275:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787865051.220346:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 282: rc = 0 00100000:10000000:0.0:1787865051.220722:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787865051.221253:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 599: rc = 0 00100000:10000000:0.0:1787865051.221605:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787865051.221956:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 599: rc = 0 00100000:10000000:0.0:1787865051.222149:0:14354:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787865051.222231:0:14354:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 599: rc = 0 00000020:00000080:0.0:1787865051.222510:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787865051.222596:0:14354:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787865051.222606:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe186192956 00000020:01000004:0.0:1787865051.222615:0:14354:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787865051.222710:0:14354:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787865051.222716:0:14354:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa105f5d800 from MGS 00000020:01000004:0.0:1787865051.222719:0:14354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787865051.222730:0:14354:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fa22f988000) 00000020:00000080:0.0:1787865051.222741:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787865051.222881:0:14354:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa105f5d800 from MGS, refs=2 00080000:01000000:0.0:1787865051.222887:0:14354:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787865051.222896:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe186192964 00000100:00100000:0.0:1787865051.223149:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787865051.223359:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787865051.223365:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787865051.224548:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787865051.224557:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787865051.226305:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787865051.226501:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787865051.226508:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787865051.227153:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787865051.227161:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787865051.229904:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787865051.229914:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787865051.230484:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865051.230487:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865051.230489:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865051.230866:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865051.230869:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865051.230870:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865051.231414:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787865051.233855:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787865051.256140:0:14354:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787865051.256158:0:14354:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787865051.256161:0:14354:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787865051.263489:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787865051.263867:0:14354:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787865051.263973:0:14354:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787865051.264894:0:14354:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787865051.266108:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787865051.266530:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787865051.266537:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787865051.268948:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787865051.268960:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787865051.269542:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787865051.269551:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787865051.271829:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787865051.271849:0:14354:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:1.0:1787865051.271850:0:14354:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787865051.271888:0:14354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:1.0:1787865051.271900:0:14354:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (ffff9fa23b670000) 00000020:00000080:1.0:1787865051.271913:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787865051.271985:0:14354:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa1072fe800@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787865051.272126:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:1.0:1787865051.272132:0:14354:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787865051.272247:0:14368:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787865051.273859:0:14369:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787865051.273926:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid 0d7f3274-06f9-466a-8cc1-a9159491893b) 00000020:00000080:0.0:1787865051.273947:0:14354:0:(genops.c:1385:class_connect()) connect: client 0d7f3274-06f9-466a-8cc1-a9159491893b, cookie 0xa63eebe186192972 00000100:00080000:0.0:1787865051.273959:0:14354:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787865051.273964:0:14354:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff9fa1072fe800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787865051.273997:0:14354:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20c1cf0c0 x1874712087052800/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787865051.274033:0:14354:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0d7f3274-06f9-466a-8cc1-a9159491893b->MGS 00000020:01000004:0.0:1787865051.274061:0:14354:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787865051.274065:0:14354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787865051.274077:0:14354:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fa22f989a48) 00000020:00000080:0.0:1787865051.274089:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787865051.277498:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d7f3274-06f9-466a-8cc1-a9159491893b:3314:1874712087052800:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787865051.277574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.277730:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087052800 00000100:00100000:2.0:1787865051.277737:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087052800 00000100:00100000:2.0:1787865051.277774:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787865051.277781:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3314:x1874712087052800:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787865051.277807:0:14366:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 0d7f3274-06f9-466a-8cc1-a9159491893b@0@lo t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:2.0:1787865051.277849:0:14366:0:(genops.c:1385:class_connect()) connect: client 0d7f3274-06f9-466a-8cc1-a9159491893b, cookie 0xa63eebe186192980 00000100:00080000:2.0:1787865051.277995:0:14366:0:(import.c:65:import_set_state_nolock()) ffff9fa202ff7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787865051.278056:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+5:3314:x1874712087052800:12345-0@lo:250:mount.lustre.0 Request processed in 273us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.278064:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865051.278496:0:3314:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787865051.278505:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:1.0:1787865051.278512:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787865051.278516:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787865051.278519:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa1072fe800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787865051.278522:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787865051.278530:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787865051.278535:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d7f3274-06f9-466a-8cc1-a9159491893b:3314:1874712087052800:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787865051.285978:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787865051.286149:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787865051.286154:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787865051.288648:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787865051.288662:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787865051.290158:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787865051.290168:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787865051.291030:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787865051.291196:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787865051.291202:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787865051.293696:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787865051.293706:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787865051.322928:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787865051.323118:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787865051.323123:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787865051.324139:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787865051.324148:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787865051.326981:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787865051.327138:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787865051.327145:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787865051.328152:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787865051.328160:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787865051.328724:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787865051.328872:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787865051.328878:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787865051.329429:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787865051.329436:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787865051.330114:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787865051.330347:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787865051.330354:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787865051.331003:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787865051.331010:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787865051.346758:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787865051.346975:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787865051.346989:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787865051.351452:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787865051.351471:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787865051.355167:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787865051.355180:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787865051.356388:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787865051.356590:0:14354:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787865051.356596:0:14354:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787865051.356727:0:14354:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787865051.356759:0:14354:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787865051.356764:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787865051.356765:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787865051.356767:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865051.356768:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865051.356769:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865051.356770:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865051.356772:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787865051.356773:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787865051.356775:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865051.356776:0:14354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787865051.356778:0:14354:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787865051.356781:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787865051.356782:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787865051.356783:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865051.356784:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865051.356785:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865051.356786:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865051.356788:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787865051.356789:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787865051.356790:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865051.356791:0:14354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787865051.356826:0:14354:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787865051.356847:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087052928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787865051.356916:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865051.356973:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.357049:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087052928 00000100:00100000:1.0:1787865051.357056:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087052928 00000100:00100000:1.0:1787865051.357105:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865051.357114:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+5:14354:x1874712087052928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787865051.357157:0:14367:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787865051.357159:0:14367:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787865051.357162:0:14367:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787865051.357563:0:14388:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787865051.357881:0:14367:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787865051.359175:0:14389:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787865051.359180:0:14389:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787865051.359183:0:14389:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787865051.359227:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787865051.359625:0:14367:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787865051.359636:0:14367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787865051.372997:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+5:14354:x1874712087052928:12345-0@lo:253:mount.lustre.0 Request processed in 15875us (16071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.373010:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787865051.373088:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087052928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787865051.373102:0:14354:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787865051.373104:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787865051.373106:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787865051.373119:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865051.373120:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865051.373121:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865051.373122:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865051.373124:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787865051.373125:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787865051.373127:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865051.373128:0:14354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787865051.373144:0:14354:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa105f5d800 from lustre-MDT0000 10000000:01000000:0.0:1787865051.373166:0:14354:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787865051.373169:0:14354:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787865051.373173:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa23b670000 10000000:01000000:0.0:1787865051.373177:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787865051.373196:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa23b670000 from 1 10000000:01000000:0.0:1787865051.373199:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787865051.373233:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.373243:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.373252:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865051.373268:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787865051.373298:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865051.373334:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787865051.373427:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053056 00000100:00100000:2.0:1787865051.373433:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053056 00000100:00100000:2.0:1787865051.373651:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787865051.373661:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+5:14354:x1874712087053056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865051.373672:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865051.373695:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa203581c00/0xa63eebe18619298e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192987 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.373716:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203581c00/0xa63eebe18619298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192987 expref: 6 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.373726:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa203581c00/0xa63eebe18619298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192987 expref: 6 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.373741:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581c00, rc 0) 00000100:00100000:2.0:1787865051.373783:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+6:14354:x1874712087053056:12345-0@lo:101:mount.lustre.0 Request processed in 124us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.373789:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787865051.373850:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865051.373861:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.373868:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.373913:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865051.373939:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.374131:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.374220:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053184 00000100:00100000:0.0:1787865051.374225:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053184 00000100:00100000:0.0:1787865051.374248:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865051.374255:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+6:14354:x1874712087053184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865051.374495:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+6:14354:x1874712087053184:12345-0@lo:501:mount.lustre.0 Request processed in 239us (554us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787865051.374509:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787865051.374727:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053184:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787865051.374756:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787865051.374779:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.374788:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865051.374803:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa105f5d800 10000000:01000000:1.0:1787865051.374807:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787865051.374811:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa105f5d800 10000000:01000000:1.0:1787865051.374814:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787865051.374817:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa105f5d800 from 1 10000000:01000000:1.0:1787865051.374819:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787865051.374839:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.374847:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.374854:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.374866:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865051.374894:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.374912:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787865051.374966:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053312 00000100:00100000:2.0:1787865051.374970:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053312 00000100:00100000:2.0:1787865051.375004:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787865051.375012:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+6:14354:x1874712087053312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865051.375020:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865051.375029:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa203580600/0xa63eebe18619299c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192995 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.375044:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203580600/0xa63eebe18619299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192995 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.375053:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa203580600/0xa63eebe18619299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192995 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.375060:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580600, rc 0) 00000100:00100000:2.0:1787865051.375095:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+7:14354:x1874712087053312:12345-0@lo:101:mount.lustre.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.375101:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787865051.375202:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865051.375213:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619299c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.375220:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe18619299c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865051.375230:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787865051.375244:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619299c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.375257:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336ae00/0xa63eebe186192995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619299c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865051.375263:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787865051.375266:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787865051.375270:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa105f5d800 10000000:01000000:1.0:1787865051.375272:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787865051.375275:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787865051.375276:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787865051.375290:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.375295:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.375301:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.375313:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865051.375336:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.375543:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787865051.375711:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053440 00000100:00100000:3.0:1787865051.375717:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053440 00000100:00100000:0.0:1787865051.375761:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787865051.375770:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+7:14354:x1874712087053440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787865051.375778:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865051.375788:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493400/0xa63eebe1861929aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe1861929a3 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.375802:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493400/0xa63eebe1861929aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe1861929a3 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.375809:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493400/0xa63eebe1861929aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe1861929a3 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.375816:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493400, rc 0) 00000100:00100000:0.0:1787865051.375856:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+8:14354:x1874712087053440:12345-0@lo:101:mount.lustre.0 Request processed in 88us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.375861:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787865051.375932:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865051.375945:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861929aa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.375952:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe1861929aa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.376010:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865051.376035:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.376056:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.376175:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053568 00000100:00100000:0.0:1787865051.376180:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053568 00000100:00100000:0.0:1787865051.376221:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787865051.376228:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+8:14354:x1874712087053568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865051.376715:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14354:x1874712087053568:12345-0@lo:501:mount.lustre.0 Request processed in 486us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.376722:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787865051.376791:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865051.376824:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865051.376861:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.376892:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787865051.376953:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053696 00000100:00100000:2.0:1787865051.376959:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053696 00000100:00100000:2.0:1787865051.376991:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787865051.376999:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14354:x1874712087053696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865051.377300:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14354:x1874712087053696:12345-0@lo:503:mount.lustre.0 Request processed in 301us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.377312:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787865051.379223:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087053696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865051.379855:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14390:1874712087053824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787865051.379923:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.379966:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086480 going to sleep for 11 seconds 00000100:00100000:3.0:1787865051.380111:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087053824 00000100:00100000:3.0:1787865051.380117:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087053824 00000100:00100000:0.0:1787865051.380235:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787865051.380246:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14390:x1874712087053824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787865051.380955:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14390:x1874712087053824:12345-0@lo:502:llog_process_th.0 Request processed in 709us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.380964:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787865051.381100:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14390:1874712087053824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787865051.381130:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.381141:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.381144:0:14390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787865051.381149:0:14390:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787865051.381151:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787865051.381164:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fa212c91a48) 00000020:00000080:2.0:1787865051.381180:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787865051.381195:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787865051.381259:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787865051.381266:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861929b8 00000020:00000080:3.0:1787865051.381707:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787865051.381714:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787865051.381719:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865051.381721:0:14390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787865051.381732:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787865051.381736:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865051.381737:0:14390:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787865051.381740:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787865051.381748:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fa205943490) 00000020:00000080:3.0:1787865051.381759:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787865051.381764:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787865051.381766:0:14390:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787865051.381768:0:14390:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787865051.381775:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787865051.381824:0:14390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa105f5d800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787865051.381836:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fa205941a48) 00000020:00000080:3.0:1787865051.381844:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787865051.381884:0:14390:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787865051.381889:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe1861929cd 00000020:00000080:3.0:1787865051.381970:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787865051.381976:0:14390:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787865051.381979:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa63eebe1861929d4 00080000:01000000:3.0:1787865051.381984:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787865051.381987:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861929db 00010000:00010000:3.0:1787865051.475868:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787865051.476328:0:14390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787865051.476543:0:14390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787865051.483011:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fa205944ed8) 00000020:00000080:3.0:1787865051.486110:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787865051.486214:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787865051.486225:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861929e9 00000020:00000080:3.0:1787865051.488325:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787865051.506989:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa63eebe1861929f0 00000020:00000080:1.0:1787865051.508286:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787865051.508298:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865051.508305:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865051.508307:0:14390:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787865051.508312:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787865051.508315:0:14390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787865051.508316:0:14390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787865051.508318:0:14390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787865051.508319:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787865051.508322:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865051.508323:0:14390:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787865051.508326:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787865051.508340:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865051.508342:0:14390:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787865051.508346:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787865051.508388:0:14390:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787865051.508433:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865051.508437:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865051.508439:0:14390:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787865051.508441:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787865051.508444:0:14390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787865051.508447:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865051.508449:0:14390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787865051.508452:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787865051.508456:0:14390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:1.0:1787865051.508480:0:14390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787865051.508483:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787865051.508497:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa23b671a48) 00000020:00000080:1.0:1787865051.508512:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787865051.508517:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787865051.508571:0:14390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787865051.508576:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787865051.508583:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe1861929fe 00010000:00080000:1.0:1787865051.508628:0:14390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa203fd2800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787865051.508893:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787865051.509246:0:14390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787865051.509294:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787865051.510236:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865051.510290:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787865051.510373:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787865051.521295:0:14394:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787865051.521304:0:14394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787865051.524160:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787865051.524176:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787865051.524221:0:14390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787865051.524240:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186192a05 00000100:00080000:0.0:1787865051.524250:0:14390:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787865051.524256:0:14390:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa203fd2800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787865051.524290:0:14390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20c1cda40 x1874712087053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787865051.524356:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087053952:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787865051.524461:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874712087053952 offset 0 length 520: 4 00000100:00080000:0.0:1787865051.524671:0:14390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787865051.524767:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787865051.524772:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787865051.524774:0:14390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787865051.524777:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787865051.524780:0:14390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787865051.524782:0:14390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787865051.524784:0:14390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787865051.524785:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787865051.524788:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787865051.524789:0:14390:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787865051.524791:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787865051.524795:0:14390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787865051.524798:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787865051.524799:0:14390:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787865051.524802:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787865051.524805:0:14390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:0.0:1787865051.524825:0:14390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787865051.524828:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787865051.524840:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa22f98ced8) 00000020:00000080:0.0:1787865051.524853:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787865051.524858:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787865051.524928:0:14390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787865051.524934:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787865051.524939:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa63eebe186192a13 00010000:00080000:0.0:1787865051.524967:0:14390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa23fd34800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787865051.525159:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787865051.525441:0:14390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787865051.525465:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787865051.526277:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787865051.526339:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787865051.529815:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000020:00000080:2.0:1787865051.531023:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787865051.531036:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787865051.531067:0:14390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787865051.531083:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186192a1a 00000100:00080000:2.0:1787865051.531093:0:14390:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787865051.531098:0:14390:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa23fd34800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787865051.531128:0:14390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa1075d7480 x1874712087054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787865051.531155:0:14390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787865051.531223:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.531227:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.531229:0:14390:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787865051.531231:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.531235:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.531241:0:14390:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787865051.531244:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787865051.531246:0:14390:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787865051.531248:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.531250:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.531251:0:14390:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787865051.531253:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.531255:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.531256:0:14390:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787865051.531259:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787865051.531286:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14390:1874712087054208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787865051.531352:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.531389:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.531475:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087054080:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787865051.531511:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874712087054080 offset 0 length 520: 4 00000100:00100000:0.0:1787865051.531771:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054208 00000100:00100000:0.0:1787865051.531777:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054208 00000100:00100000:0.0:1787865051.531821:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787865051.531830:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14390:x1874712087054208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787865051.532306:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14390:x1874712087054208:12345-0@lo:502:llog_process_th.0 Request processed in 475us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.532314:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:0.0:1787865051.532378:0:14396:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787865051.532382:0:14396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1787865051.532494:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14390:1874712087054208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787865051.532523:0:14390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.532529:0:14390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.532531:0:14390:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787865051.532535:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787865051.532725:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787865051.532743:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787865051.532765:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861929aa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.532776:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336b800/0xa63eebe1861929a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe1861929aa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865051.532783:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa105f5d800 from 1 10000000:01000000:1.0:1787865051.532786:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787865051.532812:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.532820:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.532828:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.532843:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865051.532873:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.532900:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086480 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.532917:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054336 00000100:00100000:1.0:1787865051.532921:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054336 00000100:00100000:1.0:1787865051.532948:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787865051.532956:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+9:14354:x1874712087054336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865051.532964:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865051.532976:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a21 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.533004:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a21 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.533013:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a21 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.533022:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ba00, rc 0) 00000100:00100000:1.0:1787865051.533052:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+10:14354:x1874712087054336:12345-0@lo:101:mount.lustre.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.533059:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787865051.533093:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865051.533105:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.533113:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865051.533895:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054464:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787865051.533941:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.533963:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210086480 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.534016:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054464 00000100:00100000:0.0:1787865051.534021:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054464 00000100:00100000:0.0:1787865051.534054:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787865051.534060:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+10:14354:x1874712087054464:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787865051.534075:0:14365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787865051.534079:0:14365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787865051.534151:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+10:14354:x1874712087054464:12345-0@lo:256:mount.lustre.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.534158:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787865051.534234:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054464:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787865051.534917:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787865051.536891:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.536909:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865051.536918:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105f5d800 from 1 10000000:01000000:2.0:1787865051.536922:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787865051.536964:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.537033:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.537043:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865051.537066:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787865051.537128:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.537170:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.537316:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054592 00000100:00100000:0.0:1787865051.537330:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054592 00000100:00100000:0.0:1787865051.537370:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787865051.537379:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+10:14354:x1874712087054592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787865051.537392:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865051.537436:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a2f expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.537459:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a2f expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.537469:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a2f expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.537478:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492a00, rc 0) 00000100:00100000:0.0:1787865051.537518:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087054592:12345-0@lo:101:mount.lustre.0 Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.537525:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787865051.537735:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865051.537752:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.537761:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865051.537819:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865051.537844:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.537919:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.540815:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054720 00000100:00100000:0.0:1787865051.540828:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054720 00000100:00100000:0.0:1787865051.540928:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787865051.540939:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087054720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865051.541355:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087054720:12345-0@lo:501:mount.lustre.0 Request processed in 417us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.541363:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787865051.541466:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865051.541520:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865051.541567:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.542954:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.543063:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054848 00000100:00100000:1.0:1787865051.543071:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054848 00000100:00100000:1.0:1787865051.543112:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787865051.543122:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087054848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865051.543347:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087054848:12345-0@lo:503:mount.lustre.0 Request processed in 226us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.543365:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787865051.543488:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087054848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865051.543862:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14398:1874712087054976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787865051.543916:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.543950:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.543994:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087054976 00000100:00100000:1.0:1787865051.544000:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087054976 00000100:00100000:1.0:1787865051.544023:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787865051.544030:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14398:x1874712087054976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787865051.544251:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14398:x1874712087054976:12345-0@lo:502:llog_process_th.0 Request processed in 220us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.544258:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787865051.544434:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14398:1874712087054976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787865051.544458:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.544467:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.544469:0:14398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787865051.544475:0:14398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa105f5d800 00000020:00000080:2.0:1787865051.544477:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787865051.544484:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.544486:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.544488:0:14398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787865051.544490:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.544492:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.544493:0:14398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787865051.544496:0:14398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa105f5d800 00000020:00000080:2.0:1787865051.544498:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787865051.544546:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.544549:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.544551:0:14398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787865051.544553:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865051.544556:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.544557:0:14398:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787865051.544560:0:14398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa105f5d800 00000020:00000080:2.0:1787865051.544561:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787865051.544596:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14398:1874712087055104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787865051.544629:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865051.544643:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.553903:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055104 00000100:00100000:0.0:1787865051.553918:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055104 00000100:00100000:0.0:1787865051.553979:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787865051.553988:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14398:x1874712087055104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787865051.554254:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14398:x1874712087055104:12345-0@lo:502:llog_process_th.0 Request processed in 267us (9623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.554262:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787865051.558621:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14398:1874712087055104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787865051.558670:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865051.558694:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865051.558697:0:14398:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787865051.558701:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787865051.561516:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787865051.561550:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787865051.561575:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.561598:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865051.561642:0:14354:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787865051.561645:0:14354:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa105f5d800 10000000:01000000:3.0:1787865051.561648:0:14354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa105f5d800 10000000:01000000:3.0:1787865051.561651:0:14354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787865051.561657:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa105f5d800 from 1 10000000:01000000:3.0:1787865051.561659:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787865051.561696:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.561704:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.561715:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865051.561739:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787865051.561807:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865051.561841:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055232 00000100:00100000:0.0:1787865051.561849:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055232 00000100:00100000:3.0:1787865051.561854:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.561895:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787865051.561905:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087055232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787865051.561919:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865051.561932:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493e00/0xa63eebe186192a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a3d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.561955:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493e00/0xa63eebe186192a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a3d expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.561967:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493e00/0xa63eebe186192a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a3d expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.561976:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493e00, rc 0) 00000100:00100000:0.0:1787865051.562024:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087055232:12345-0@lo:101:mount.lustre.0 Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.562031:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787865051.563554:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787865051.563576:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a44 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.563587:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192a44 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865051.563665:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787865051.563719:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865051.566901:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66840 going to sleep for 11 seconds 00000100:00100000:1.0:1787865051.571882:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055360 00000100:00100000:1.0:1787865051.571895:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055360 00000100:00100000:1.0:1787865051.571944:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787865051.571955:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087055360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865051.572249:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087055360:12345-0@lo:501:mount.lustre.0 Request processed in 296us (8529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865051.572258:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787865051.572557:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787865051.572607:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787865051.572654:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865051.572688:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66840 going to sleep for 11 seconds 00000100:00100000:3.0:1787865051.572703:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055488 00000100:00100000:3.0:1787865051.572708:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055488 00000100:00100000:3.0:1787865051.572947:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787865051.572956:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087055488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787865051.573098:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087055488:12345-0@lo:503:mount.lustre.0 Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865051.573106:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787865051.573135:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087055488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865051.575853:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14403:1874712087055616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787865051.575933:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.575980:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208b22900 going to sleep for 11 seconds 00000100:00100000:2.0:1787865051.576076:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055616 00000100:00100000:2.0:1787865051.576082:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055616 00000100:00100000:2.0:1787865051.576128:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787865051.576138:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14403:x1874712087055616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787865051.576375:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14403:x1874712087055616:12345-0@lo:502:llog_process_th.0 Request processed in 238us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.576383:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787865051.576865:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14403:1874712087055616:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787865051.576932:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787865051.576947:0:14403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fa23b674ed8) 00000020:00000080:1.0:1787865051.576968:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787865051.577053:0:14403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa105f5d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787865051.577057:0:14403:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa105f5d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787865051.577060:0:14403:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa105f5d800 4 00010000:00080000:1.0:1787865051.577096:0:14403:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa22f9aa800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787865051.583766:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787865051.584271:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787865051.584308:0:14403:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787865051.584321:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa63eebe186192a52 00000100:00080000:1.0:1787865051.584331:0:14403:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787865051.584336:0:14403:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa22f9aa800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787865051.584368:0:14403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f558f00 x1874712087055744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787865051.584419:0:14403:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787865051.584544:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087055744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787865051.584819:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.584966:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055744 00000100:00100000:1.0:1787865051.584973:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055744 00000100:00100000:1.0:1787865051.585001:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865051.585009:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1874712087055744:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787865051.585069:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1874712087055744:12345-0@lo:38:llog_process_th.0 Request processed in 58us (251us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787865051.585076:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865051.585119:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787865051.585129:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f9aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787865051.585132:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787865051.585136:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087055744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787865051.585243:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14403:1874712087055872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787865051.585286:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865051.585311:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208b22900 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.585432:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087055872 00000100:00100000:0.0:1787865051.585438:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087055872 00000100:00100000:0.0:1787865051.585471:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787865051.585480:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14403:x1874712087055872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787865051.585922:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14403:x1874712087055872:12345-0@lo:502:llog_process_th.0 Request processed in 442us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.585931:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787865051.588340:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d7f3274-06f9-466a-8cc1-a9159491893b:14403:1874712087055872:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787865051.588524:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787865051.588842:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787865051.588869:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787865051.588928:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a44 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.588939:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa23b351c00/0xa63eebe186192a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a44 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787865051.588999:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787865051.589001:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787865051.589003:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865051.589004:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865051.589006:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865051.589008:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865051.589010:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787865051.589011:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787865051.589013:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865051.589015:0:14354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787865051.589018:0:14354:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787865051.589021:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787865051.589022:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787865051.589023:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865051.589024:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865051.589026:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865051.589027:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865051.589028:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787865051.589030:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787865051.589031:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865051.589033:0:14354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787865051.589058:0:14354:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787865051.589077:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087056000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787865051.589210:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865051.589260:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b504d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787865051.589280:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056000 00000100:00100000:0.0:1787865051.589286:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056000 00000100:00100000:0.0:1787865051.589325:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787865051.589333:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14354:x1874712087056000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787865051.589374:0:14366:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787865051.589387:0:14366:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787865051.662176:0:14366:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787865051.662207:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787865051.662486:0:14388:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787865051.662492:0:14388:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787865051.662517:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.662537:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a21 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.662545:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.662610:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865051.662624:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 12 pid: 14366 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865051.662636:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087056128:0@lo:104: 00000100:00100000:3.0:1787865051.662695:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865051.662748:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203e66d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787865051.663094:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056128 00000100:00100000:2.0:1787865051.663102:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056128 00000100:00100000:2.0:1787865051.663140:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787865051.663149:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087056128:12345-0@lo:104: 00010000:00010000:2.0:1787865051.663162:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865051.663246:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787865051.663252:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087056128:12345-0@lo:104: Request processed in 106us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.663259:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787865051.663323:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865051.663330:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.663337:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787865051.663340:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.663348:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787865051.663355:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865051.663361:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787865051.663418:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.663425:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787865051.663443:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.663449:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a400/0xa63eebe186192a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a28 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.663465:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865051.663467:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865051.663469:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865051.663485:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787865051.663495:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d7f3274-06f9-466a-8cc1-a9159491893b:3318:1874712087056256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865051.663506:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087056128:0@lo:104: 00000100:00100000:1.0:1787865051.663523:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787865051.663524:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865051.663760:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056256 00000100:00100000:0.0:1787865051.663765:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056256 00010000:00010000:0.0:1787865051.663785:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 13 pid: 14366 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865051.663814:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787865051.663822:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+13:3318:x1874712087056256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787865051.663832:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865051.663837:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 13 pid: 14366 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663848:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 13 pid: 14366 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663861:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336ba00/0xa63eebe186192a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192a21 expref: 13 pid: 14366 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663875:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663883:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787865051.663907:0:14357:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001415816s 00010000:00010000:0.0:1787865051.663912:0:14357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663918:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663925:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663930:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663936:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865051.663940:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663947:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663968:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865051.663976:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865051.664027:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3318:x1874712087056256:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865051.664035:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787865051.664126:0:14388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.664134:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865051.664181:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b350000/0xa63eebe186192a59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865051.664252:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d7f3274-06f9-466a-8cc1-a9159491893b:3318:1874712087056256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865051.703448:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14354:x1874712087056000:12345-0@lo:253:mount.lustre.0 Request processed in 114106us (114229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865051.703465:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787865051.703696:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ccf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:14354:1874712087056000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787865051.703713:0:14354:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787865051.703717:0:14354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787865051.703718:0:14354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787865051.703720:0:14354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787865051.703721:0:14354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787865051.703722:0:14354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787865051.703723:0:14354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787865051.703725:0:14354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787865051.703726:0:14354:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787865051.703728:0:14354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787865051.703730:0:14354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787865051.703744:0:14354:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787865051.712569:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865051.714164:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865051.714491:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865051.715068:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865051.715370:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865051.716066:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865051.717358:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865051.717719:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865051.717993:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865051.718243:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787865051.719304:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787865051.719512:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787865051.784458:0:14354:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787865051.785388:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787865051.785486:0:14410:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787865051.785490:0:14410:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787865051.785900:0:14411:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787865051.785986:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787865051.792329:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787865051.792487:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787865051.794908:0:14354:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787865051.794930:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787865051.795197:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787865051.797527:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1787865051.799718:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:3.0:1787865051.801055:0:14411:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787865051.801064:0:14411:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1787865051.801911:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787865051.801955:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787865051.804269:0:14354:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1787865051.806466:0:14354:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787865051.820974:0:14354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787865051.859307:0:14354:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787865051.859350:0:14354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb035c150f988 00100000:10000000:2.0:1787865051.859359:0:14354:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787865051.860306:0:14354:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787865051.860324:0:14354:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787865051.860335:0:14354:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787865051.860358:0:14354:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787865052.284653:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787865052.604596:0:14404:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787865052.604605:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787865052.604930:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787865052.604937:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1787865052.924792:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787865052.924809:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa105f5d800 from 6 10000000:01000000:1.0:1787865052.924814:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787865052.924858:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865052.924870:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865052.924883:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865052.924914:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087056384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787865052.924981:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865052.925051:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787865052.925257:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056384 00000100:00100000:3.0:1787865052.925265:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056384 00000100:00100000:3.0:1787865052.925323:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787865052.925332:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14369:x1874712087056384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865052.925345:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865052.925358:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a60 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865052.925381:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a60 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865052.925392:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a60 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865052.925425:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351000, rc 0) 00000100:00100000:3.0:1787865052.925466:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087056384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865052.925479:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787865052.925695:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087056384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865052.925710:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865052.925720:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865052.925766:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087056512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787865052.925796:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865052.925826:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204f21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787865052.925884:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056512 00000100:00100000:1.0:1787865052.925889:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056512 00000100:00100000:1.0:1787865052.925921:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787865052.925928:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087056512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787865052.925942:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787865052.925957:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787865052.925960:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787865052.926029:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087056512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865052.926049:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787865052.926731:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087056512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787865052.926776:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787865052.926783:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865052.926792:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865053.307898:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787865053.627592:0:14404:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787865053.627601:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787865053.627637:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787865053.627644:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787865054.332563:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865055.356211:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787865055.592618:0:14654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787865056.384120:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787865056.763752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865056.763759:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787865056.763762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865056.763765:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787865056.763768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787865056.763770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787865056.763774:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fa22f9aa800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787865056.763786:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa22f9aa800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787865056.763811:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa1075d5680 x1874712087056768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787865056.763846:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087056768:0@lo:38:kworker.0 00000100:00100000:2.0:1787865056.763914:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865056.764175:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d7f3274-06f9-466a-8cc1-a9159491893b:3318:1874712087056640:0@lo:400:kworker.0 00000100:00100000:1.0:1787865056.764213:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865056.764281:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056768 00000100:00100000:1.0:1787865056.764288:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056768 00000100:00100000:1.0:1787865056.764321:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865056.764328:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874712087056768:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787865056.764353:0:14374:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:1.0:1787865056.764392:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa63eebe186192a6e 00000004:00100000:1.0:1787865056.764456:0:14374:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787865056.764600:0:14374:0:(import.c:65:import_set_state_nolock()) ffff9fa205331800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787865056.764670:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874712087056768:12345-0@lo:38:kworker.0 Request processed in 340us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865056.764677:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787865056.766901:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056640 00000100:00100000:2.0:1787865056.766919:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056640 00000100:00100000:2.0:1787865056.767359:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787865056.767370:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3318:x1874712087056640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865056.767498:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3318:x1874712087056640:12345-0@lo:400:kworker.0 Request processed in 130us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865056.767514:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787865056.767612:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d7f3274-06f9-466a-8cc1-a9159491893b:3318:1874712087056640:0@lo:400:kworker.0 00010000:00080000:3.0:1787865056.769623:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa1075d5680 x1874712087056768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787865066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787865056.769648:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787865056.769656:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787865056.769660:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787865056.769664:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa22f9aa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787865056.769671:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874712087056768:0@lo:38:kworker.0 00010000:00010000:0.0:1787865057.405572:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787865058.223252:0:14805:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1cc152c0 20000000:00000080:2.0:1787865058.223268:0:14805:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2125e1400 uarg=0000000000000000 20000000:01000000:2.0:1787865058.223308:0:14805:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787865058.223315:0:14805:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787865058.223320:0:14805:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787865058.228607:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787865058.229884:0:14805:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787865058.236846:0:14805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787865058.236874:0:14805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865058.236893:0:14805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a2f expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865058.236901:0:14805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865058.236941:0:14805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865058.236955:0:14805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 11 pid: 14367 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865058.236968:0:14805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1874712087056896:0@lo:104: 00000100:00100000:2.0:1787865058.237029:0:14805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865058.237085:0:14805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204c9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865058.237171:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087056896 00000100:00100000:0.0:1787865058.237179:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087056896 00000100:00100000:0.0:1787865058.237257:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787865058.237267:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14805:x1874712087056896:12345-0@lo:104: 00010000:00010000:0.0:1787865058.237279:0:14356:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865058.237344:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787865058.237350:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14805:x1874712087056896:12345-0@lo:104: Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865058.237358:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787865058.237449:0:14805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14805:1874712087056896:0@lo:104: 00010000:00010000:3.0:1787865058.237477:0:14805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237588:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865058.237594:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237602:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787865058.237606:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237612:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787865058.237618:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865058.237623:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787865058.237659:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237665:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787865058.237697:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237704:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa203580a00/0xa63eebe186192a2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a36 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237732:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865058.237734:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865058.237735:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865058.237759:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087057024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865058.237788:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865058.237840:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057024 00000100:00100000:1.0:1787865058.237844:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057024 00010000:00010000:1.0:1787865058.237862:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 12 pid: 14367 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865058.237884:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865058.237890:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3315:x1874712087057024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787865058.237900:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865058.237904:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 12 pid: 14367 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237914:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 12 pid: 14367 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237927:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa211492a00/0xa63eebe186192a36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192a2f expref: 12 pid: 14367 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237939:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237946:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237958:0:14357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237971:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237977:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237983:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.237989:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865058.237993:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.238000:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.238010:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865058.238018:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865058.238049:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+11:3315:x1874712087057024:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865058.238056:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865058.238085:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087057024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865058.239813:0:14805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865058.239826:0:14805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865058.239832:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa203581a00/0xa63eebe186192a75 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865058.428267:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865059.453342:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787865059.837003:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787865059.837011:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105f5d800 from 10 10000000:01000000:1.0:1787865059.837016:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787865059.837069:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865059.837178:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865059.837190:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865059.837216:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787865059.837283:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865059.837355:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b504b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787865059.837595:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057152 00000100:00100000:0.0:1787865059.837602:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057152 00000100:00100000:0.0:1787865059.837663:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787865059.837683:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+11:14369:x1874712087057152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865059.837696:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865059.837710:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a7c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865059.837731:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a7c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865059.837969:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a7c expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865059.837978:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492000, rc 0) 00000100:00100000:0.0:1787865059.838033:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087057152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865059.838041:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787865059.838120:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865059.838135:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865059.838155:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865059.838209:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787865059.838237:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865059.838315:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa208e476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787865059.838389:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057280 00000100:00100000:2.0:1787865059.840117:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057280 00000100:00100000:2.0:1787865059.840187:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787865059.840197:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087057280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787865059.840492:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087057280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865059.840506:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787865059.840554:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787865059.840609:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787865059.840656:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865059.840687:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204de6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787865059.840701:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057408 00000100:00100000:2.0:1787865059.840705:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057408 00000100:00100000:2.0:1787865059.840731:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787865059.840739:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087057408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787865059.840883:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:14369:x1874712087057408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865059.840891:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787865059.840935:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087057408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787865059.843070:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787865059.843309:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787865059.843330:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787865059.843341:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865059.843352:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865060.476433:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865061.502928:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865061.884385:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787865051/real 1787865051] req@ffff9fa1075d7480 x1874712087054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865061.884433:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa1075d7480 x1874712087054080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865061.884444:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787865051/real 1787865051] req@ffff9fa20c1cda40 x1874712087053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865061.884456:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa20c1cda40 x1874712087053952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787865061.884491:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd34800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787865061.884499:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787865061.884503:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087054080:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787865061.884508:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787865061.884513:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787865061.884516:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087053952:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787865061.884698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787865061.884703:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787865061.884705:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787865061.884710:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 367 00000100:00080000:0.0:1787865061.884715:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787865061.884721:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa203fd2800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787865061.884741:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20c1cc3c0 x1874712087057664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787865061.884752:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787865061.884755:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787865061.884757:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd34800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787865061.884760:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 367 00000100:00080000:0.0:1787865061.884762:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787865061.884765:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa23fd34800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787865061.884776:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa20c1ce580 x1874712087057792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787865061.884811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787865061.884829:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087057536:0@lo:400:kworker.0 00000100:00100000:0.0:1787865061.884907:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865061.884957:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087057920:0@lo:400:kworker.0 00000100:00100000:0.0:1787865061.884982:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865061.885024:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057920 00000100:00100000:0.0:1787865061.885030:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057920 00000100:00100000:0.0:1787865061.885072:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787865061.885081:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865061.885144:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087057920:12345-0@lo:400:kworker.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865061.885151:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787865061.885190:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa20c1cde00 x1874712087057920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865061.885203:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087057920:0@lo:400:kworker.0 00000100:00100000:2.0:1787865061.885952:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087057536 00000100:00100000:2.0:1787865061.885960:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087057536 00000100:00100000:2.0:1787865061.886005:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787865061.886013:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3315:x1874712087057536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865061.886064:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+12:3315:x1874712087057536:12345-0@lo:400:kworker.0 Request processed in 53us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865061.886071:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787865061.886111:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087057536:0@lo:400:kworker.0 00000100:00100000:2.0:1787865061.886142:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087057664:0@lo:8:kworker.0 00000400:00000100:2.0:1787865061.886169:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874712087057664 offset 0 length 520: 4 00000100:00100000:2.0:1787865061.886192:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087057792:0@lo:8:kworker.0 00000400:00000100:2.0:1787865061.886209:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874712087057792 offset 0 length 520: 4 00000020:01000004:3.0:1787865062.516584:0:15055:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787865062.516587:0:15055:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787865062.516766:0:15055:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa208006800 00000020:01000004:3.0:1787865062.516782:0:15055:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787865062.516792:0:15055:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787865062.516803:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fa205940000) 00000020:00000080:3.0:1787865062.516816:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787865062.524164:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787865062.563284:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787865062.563733:0:15055:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787865062.566107:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787865062.567552:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787865062.567832:0:15055:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787865062.574484:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787865062.574592:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787865062.574688:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787865062.575098:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 121: rc = 0 00100000:10000000:2.0:1787865062.575508:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 121: rc = 0 00100000:10000000:2.0:1787865062.575759:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 121: rc = 0 00100000:10000000:2.0:1787865062.576034:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 121: rc = 0 00100000:10000000:2.0:1787865062.576302:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 121: rc = 0 00100000:10000000:2.0:1787865062.582320:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 121: rc = 0 00000020:00000080:2.0:1787865062.582998:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787865062.583009:0:15055:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787865062.583020:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa63eebe186192a91 00000020:01000004:2.0:1787865062.583028:0:15055:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787865062.583048:0:15055:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787865062.583052:0:15055:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787865062.583058:0:15055:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787865062.583062:0:15055:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787865062.583073:0:15055:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fa212c94ed8) 00000020:00000080:2.0:1787865062.583083:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787865062.584252:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787865062.584482:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787865062.584490:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787865062.601065:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787865062.601079:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787865062.601453:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787865062.601460:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787865062.602971:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787865062.603174:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787865062.603180:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787865062.605744:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787865062.608106:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787865062.643055:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787865062.643280:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787865062.643287:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787865062.645136:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787865062.645148:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787865062.647207:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787865062.647222:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787865062.657970:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787865062.658160:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787865062.658165:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787865062.665605:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787865062.665620:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787865062.728738:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787865062.729086:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787865062.729093:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787865062.733642:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787865062.733666:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787865062.735927:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787865062.735953:0:15055:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787865062.735959:0:15055:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787865062.748181:0:15055:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787865062.748232:0:15055:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787865062.748236:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787865062.748238:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.748239:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.748240:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.748241:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.748243:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.748244:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.748245:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787865062.748246:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787865062.748250:0:15055:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787865062.748251:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787865062.748252:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.748253:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.748254:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.748255:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.748257:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.748258:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.748258:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787865062.748259:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787865062.748285:0:15055:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787865062.748303:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787865062.748376:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.749743:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b504b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787865062.750179:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058048 00000100:00100000:1.0:1787865062.750187:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058048 00000100:00100000:1.0:1787865062.750241:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787865062.750251:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:15055:x1874712087058048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787865062.750307:0:14366:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787865062.750311:0:14366:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787865062.750315:0:14366:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787865062.758079:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:15055:x1874712087058048:12345-0@lo:253:mount.lustre.0 Request processed in 7820us (9693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865062.758095:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787865062.758213:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787865062.758229:0:15055:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787865062.758232:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787865062.758234:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.758235:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.758236:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.758250:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.758251:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.758253:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.758255:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787865062.758256:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787865062.758275:0:15055:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa208006800 from lustre-OST0000 10000000:01000000:2.0:1787865062.758302:0:15055:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787865062.758305:0:15055:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787865062.758312:0:15055:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa23b670000 local copy 00010000:00010000:2.0:1787865062.758322:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865062.758580:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865062.758616:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.758644:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b5046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.758823:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058176 00000100:00100000:0.0:1787865062.758829:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058176 00000100:00100000:0.0:1787865062.758869:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787865062.758877:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:15055:x1874712087058176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865062.759037:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+12:15055:x1874712087058176:12345-0@lo:501:mount.lustre.0 Request processed in 160us (419us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787865062.759045:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787865062.759174:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058176:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787865062.759195:0:15055:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787865062.759351:0:15055:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787865062.759358:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.759368:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865062.759432:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa208006800 10000000:01000000:1.0:1787865062.759437:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787865062.759442:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa23b670000 10000000:01000000:1.0:1787865062.759444:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787865062.759447:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa23b670000 from 1 10000000:01000000:1.0:1787865062.759450:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787865062.759486:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.759494:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.759504:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865062.759517:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865062.759547:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.759714:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787865062.759866:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058304 00000100:00100000:3.0:1787865062.759871:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058304 00000100:00100000:3.0:1787865062.760044:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787865062.760053:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+12:15055:x1874712087058304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787865062.760065:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865062.760079:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b350400/0xa63eebe186192aa6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192a9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.760101:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350400/0xa63eebe186192aa6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192a9f expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.760110:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b350400/0xa63eebe186192aa6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a9f expref: 13 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.760120:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350400, rc 0) 00000100:00100000:3.0:1787865062.760178:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+13:15055:x1874712087058304:12345-0@lo:101:mount.lustre.0 Request processed in 127us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865062.760184:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787865062.760245:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865062.760257:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192aa6 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.760271:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192aa6 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865062.760290:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787865062.760306:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192aa6 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.760313:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a800/0xa63eebe186192a9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192aa6 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865062.760320:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787865062.760324:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787865062.760329:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787865062.760331:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787865062.760346:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.760353:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.760360:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865062.760372:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865062.760416:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.760696:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.760759:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058432 00000100:00100000:0.0:1787865062.760764:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058432 00000100:00100000:0.0:1787865062.760788:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787865062.760801:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+13:15055:x1874712087058432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787865062.760809:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865062.760818:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493a00/0xa63eebe186192ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192aad expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.760831:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493a00/0xa63eebe186192ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192aad expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.760840:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493a00/0xa63eebe186192ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192aad expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.760847:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493a00, rc 0) 00000100:00100000:0.0:1787865062.760883:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058432:12345-0@lo:101:mount.lustre.0 Request processed in 83us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.760888:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787865062.760955:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865062.760965:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ab4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.760978:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192ab4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865062.761783:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787865062.765121:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865062.765717:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787865062.765762:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787865062.765787:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787865062.765832:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787865062.765866:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787865062.765892:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787865062.765953:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787865062.765961:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787865062.766041:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865062.766105:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.766200:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787865062.766262:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058560 00000100:00100000:3.0:1787865062.766269:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058560 00000100:00100000:2.0:1787865062.769035:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787865062.769057:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865062.769724:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058560:12345-0@lo:501:mount.lustre.0 Request processed in 675us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.769733:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787865062.770034:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865062.770160:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865062.770205:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.770277:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.770314:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058688 00000100:00100000:2.0:1787865062.770319:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058688 00000100:00100000:2.0:1787865062.770421:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787865062.770430:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865062.770764:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058688:12345-0@lo:503:mount.lustre.0 Request processed in 335us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.770772:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787865062.770860:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787865062.771522:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787865062.771580:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865062.771628:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.772003:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.772042:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058816 00000100:00100000:0.0:1787865062.772047:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058816 00000100:00100000:0.0:1787865062.772082:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787865062.772090:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865062.772430:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058816:12345-0@lo:502:mount.lustre.0 Request processed in 339us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.772438:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787865062.772749:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865062.775852:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787865062.775931:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787865062.775966:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787865062.776014:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787865062.776050:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787865062.776086:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787865062.776166:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787865062.776203:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787865062.776239:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787865062.776296:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787865062.776335:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787865062.776573:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787865062.776622:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865062.776692:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.778571:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.778839:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087058944 00000100:00100000:0.0:1787865062.778848:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087058944 00000100:00100000:0.0:1787865062.778959:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787865062.778970:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865062.779245:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087058944:12345-0@lo:502:mount.lustre.0 Request processed in 278us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.779264:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787865062.779360:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087058944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865062.779616:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787865062.779631:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787865062.781322:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787865062.781331:0:15069:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787865062.781338:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865062.781349:0:15069:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787865062.781354:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787865062.781368:0:15069:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fa23b673490) 00000020:00000080:1.0:1787865062.781389:0:15069:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787865062.781393:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787865062.781546:0:15069:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa208006800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787865062.781553:0:15069:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787865062.781559:0:15069:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa63eebe186192ac2 00010000:00010000:1.0:1787865062.792042:0:15069:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787865062.792670:0:15069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787865062.794754:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1787865062.796287:0:15069:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787865062.796299:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865062.796312:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.796314:0:15069:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787865062.796318:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787865062.796321:0:15069:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787865062.796323:0:15069:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787865062.796324:0:15069:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787865062.796326:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787865062.796328:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.796330:0:15069:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787865062.796332:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865062.796335:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.796337:0:15069:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787865062.796339:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787865062.796341:0:15069:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787865062.796344:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865062.796346:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.796348:0:15069:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787865062.796350:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865062.796352:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.796353:0:15069:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787865062.796356:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787865062.796544:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865062.797440:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865062.797445:0:15069:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787865062.797449:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787865062.799584:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787865062.799634:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787865062.799665:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ab4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.799677:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336b000/0xa63eebe186192aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ab4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865062.799686:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa208006800 from 1 10000000:01000000:2.0:1787865062.799689:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787865062.799723:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.799741:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.799752:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865062.799774:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787865062.799905:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.799951:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059072 00000100:00100000:2.0:1787865062.799957:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059072 00000100:00100000:2.0:1787865062.799995:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787865062.800004:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+14:15055:x1874712087059072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865062.800017:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865062.800029:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192ac9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.800050:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 15 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.800061:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 15 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.800069:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581800, rc 0) 00000100:00100000:2.0:1787865062.800100:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059072:12345-0@lo:101:mount.lustre.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.800106:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787865062.800160:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b504840 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.800187:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865062.800200:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.800209:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787865062.802467:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787865062.802947:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787865062.803213:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787865062.803258:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787865062.803322:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787865062.803330:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787865062.803440:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865062.803503:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.803541:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b504840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.803791:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059200 00000100:00100000:0.0:1787865062.803799:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059200 00000100:00100000:0.0:1787865062.803856:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787865062.803867:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865062.804107:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059200:12345-0@lo:501:mount.lustre.0 Request processed in 242us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.804116:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787865062.806882:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787865062.806951:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787865062.807041:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865062.807083:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487180 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.807188:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059328 00000100:00100000:2.0:1787865062.807195:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059328 00000100:00100000:2.0:1787865062.807249:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787865062.807258:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865062.807599:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059328:12345-0@lo:503:mount.lustre.0 Request processed in 341us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.807609:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787865062.807712:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787865062.808647:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787865062.808725:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787865062.808787:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865062.808833:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487180 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.809557:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059456 00000100:00100000:2.0:1787865062.809565:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059456 00000100:00100000:2.0:1787865062.809614:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787865062.809623:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865062.809820:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059456:12345-0@lo:502:mount.lustre.0 Request processed in 198us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.809835:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787865062.811137:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787865062.811853:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787865062.811919:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787865062.811987:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787865062.812027:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787865062.812061:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787865062.812147:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787865062.812181:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787865062.812213:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787865062.812254:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787865062.812324:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865062.812373:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203487180 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.813583:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059584 00000100:00100000:2.0:1787865062.813594:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059584 00000100:00100000:2.0:1787865062.813659:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787865062.813670:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865062.813925:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059584:12345-0@lo:502:mount.lustre.0 Request processed in 256us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.813933:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787865062.814655:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787865062.814818:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787865062.814832:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787865062.823725:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865062.823737:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823739:0:15073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787865062.823745:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa208006800 00000020:00000080:2.0:1787865062.823747:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787865062.823755:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865062.823757:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823758:0:15073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787865062.823760:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865062.823762:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823763:0:15073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787865062.823766:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa208006800 00000020:00000080:2.0:1787865062.823768:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787865062.823835:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865062.823839:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823840:0:15073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787865062.823842:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787865062.823844:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823846:0:15073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787865062.823849:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa208006800 00000020:00000080:2.0:1787865062.823851:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787865062.823883:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787865062.823891:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787865062.823892:0:15073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787865062.823895:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787865062.825570:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787865062.825617:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787865062.825642:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.825656:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865062.825706:0:15055:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787865062.825709:0:15055:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa208006800 10000000:01000000:1.0:1787865062.825712:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa208006800 10000000:01000000:1.0:1787865062.825716:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787865062.825722:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa208006800 from 1 10000000:01000000:1.0:1787865062.825724:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787865062.825761:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.825768:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.825779:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865062.825800:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865062.825874:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.825931:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787865062.826636:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059712 00000100:00100000:1.0:1787865062.826644:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059712 00000100:00100000:1.0:1787865062.826696:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787865062.826707:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087059712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865062.826721:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865062.826734:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336ac00/0xa63eebe186192ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192ad7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.826759:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336ac00/0xa63eebe186192ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192ad7 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.826769:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336ac00/0xa63eebe186192ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192ad7 expref: 16 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.826777:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336ac00, rc 0) 00000100:00100000:1.0:1787865062.826831:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087059712:12345-0@lo:101:mount.lustre.0 Request processed in 125us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865062.826838:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787865062.826891:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865062.826907:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ade expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.826915:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192ade expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865062.828701:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787865062.829057:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865062.829338:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787865062.829434:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787865062.830900:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787865062.830996:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787865062.831034:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787865062.831082:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787865062.831120:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787865062.831167:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787865062.831216:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787865062.831254:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787865062.831285:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787865062.831333:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787865062.831368:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787865062.831436:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787865062.834730:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787865062.834816:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787865062.834851:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787865062.839077:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787865062.839166:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787865062.839218:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787865062.839277:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787865062.839314:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787865062.839368:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787865062.839623:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787865062.839684:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787865062.839726:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787865062.839778:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787865062.839826:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787865062.845877:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787865062.845938:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787865062.846065:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865062.846145:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.846200:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.847239:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059840 00000100:00100000:2.0:1787865062.847250:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059840 00000100:00100000:2.0:1787865062.847307:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787865062.847317:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087059840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865062.847643:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087059840:12345-0@lo:501:mount.lustre.0 Request processed in 325us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.847651:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787865062.849506:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787865062.849568:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787865062.849643:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.849682:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087059968 00000100:00100000:3.0:1787865062.849686:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2011ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787865062.849689:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087059968 00000100:00100000:2.0:1787865062.851140:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787865062.851153:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087059968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865062.852243:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087059968:12345-0@lo:503:mount.lustre.0 Request processed in 1084us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865062.852262:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787865062.852299:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087059968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787865062.853262:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787865062.853349:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787865062.853436:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865062.853467:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2011ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787865062.854590:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060096 00000100:00100000:1.0:1787865062.854601:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060096 00000100:00100000:1.0:1787865062.854664:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787865062.854677:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087060096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865062.854986:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087060096:12345-0@lo:502:mount.lustre.0 Request processed in 312us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865062.854995:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787865062.855118:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787865062.855367:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787865062.855455:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787865062.855492:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787865062.855539:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787865062.855596:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787865062.855640:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787865062.855674:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787865062.855706:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787865062.855749:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787865062.855783:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787865062.855815:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787865062.855862:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787865062.855894:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787865062.856087:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787865062.856178:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787865062.856269:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787865062.856324:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787865062.856377:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787865062.856443:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787865062.856488:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787865062.856565:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787865062.856610:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787865062.856645:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787865062.856703:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787865062.856739:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787865062.856773:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787865062.856818:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787865062.856852:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787865062.856881:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787865062.858329:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787865062.858434:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787865062.858479:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787865062.858525:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787865062.858577:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787865062.858613:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787865062.858670:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787865062.858733:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787865062.858779:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787865062.858836:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787865062.858883:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787865062.861175:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787865062.861256:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865062.861309:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2011ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865062.861754:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060224 00000100:00100000:0.0:1787865062.861762:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060224 00000100:00100000:0.0:1787865062.861819:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787865062.861829:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087060224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865062.865444:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087060224:12345-0@lo:502:mount.lustre.0 Request processed in 3609us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.865458:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787865062.865485:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787865062.865617:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787865062.865637:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787865062.869349:0:15078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787865062.869367:0:15078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa205951a48) 00000020:00000080:0.0:1787865062.869387:0:15078:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787865062.869514:0:15078:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa208006800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787865062.869519:0:15078:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa208006800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787865062.869522:0:15078:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa208006800 3 00010000:00080000:0.0:1787865062.869552:0:15078:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa203561800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787865062.877103:0:15078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787865062.877601:0:15078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787865062.877637:0:15078:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787865062.877651:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa63eebe186192aec 00000100:00080000:2.0:1787865062.877662:0:15078:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787865062.877668:0:15078:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa203561800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787865062.877700:0:15078:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa1075d70c0 x1874712087060352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787865062.877744:0:15078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787865062.878023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787865062.878028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787865062.878031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787865062.878034:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787865062.880932:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787865062.880960:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087060480:0@lo:400:kworker.0 00000100:00100000:0.0:1787865062.881041:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865062.881098:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712087060352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787865062.881148:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787865062.882666:0:15078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1787865062.882702:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060480 00000100:00100000:1.0:1787865062.882710:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060480 00000100:00100000:1.0:1787865062.882754:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060352 00000100:00100000:1.0:1787865062.882757:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060352 00000100:00100000:1.0:1787865062.882770:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865062.882779:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087060480:12345-0@lo:400:kworker.0 00000020:01000000:2.0:1787865062.882785:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787865062.882811:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787865062.882827:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ade expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865062.882838:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336bc00/0xa63eebe186192ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192ade expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865062.882857:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087060480:12345-0@lo:400:kworker.0 Request processed in 80us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865062.882865:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865062.882879:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787865062.882883:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1874712087060352:12345-0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787865062.882888:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787865062.882890:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.882892:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.882893:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.882894:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.882895:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.882897:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.882899:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787865062.882900:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787865062.882904:0:15055:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00010000:00080000:1.0:1787865062.882904:0:14373:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:01000004:2.0:1787865062.882907:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787865062.882908:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.882909:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.882911:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.882912:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.882913:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.882913:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.882915:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:00000080:1.0:1787865062.882938:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa63eebe186192af3 00000004:00100000:1.0:1787865062.882953:0:14373:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787865062.883674:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9fa203e5b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787865062.883739:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874712087060352:12345-0@lo:38:llog_process_th.0 Request processed in 852us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865062.883749:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1787865062.884215:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787865062.884238:0:15055:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787865062.884255:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787865062.884304:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865062.884332:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204de6cc0 going to sleep for 11 seconds 00010000:00080000:0.0:1787865062.884517:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa1075d70c0 x1874712087060352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787865072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865062.884529:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00080000:1.0:1787865062.884531:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa22f55ad00 x1874712087060480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787865062.884537:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:1.0:1787865062.884540:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087060480:0@lo:400:kworker.0 00000100:00080000:0.0:1787865062.884544:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787865062.884548:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787865062.884550:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa203561800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787865062.884555:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1874712087060352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787865062.884627:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060608 00000100:00100000:3.0:1787865062.884632:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060608 00000100:00100000:3.0:1787865062.884673:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787865062.884681:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15055:x1874712087060608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787865062.884711:0:14367:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787865062.884723:0:14367:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787865062.903473:0:14367:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787865062.903488:0:14367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787865062.904061:0:14388:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787865062.904067:0:14388:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787865062.904090:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.904108:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a60 expref: 16 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.904117:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.904163:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 16 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865062.904178:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 16 pid: 14367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865062.904192:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087060736:0@lo:104: 00000100:00100000:1.0:1787865062.904255:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.904304:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa21148c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787865062.904368:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060736 00000100:00100000:3.0:1787865062.904375:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060736 00000100:00100000:3.0:1787865062.904449:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787865062.904468:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087060736:12345-0@lo:104: 00010000:00010000:3.0:1787865062.904480:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904530:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787865062.904535:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087060736:12345-0@lo:104: Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865062.904541:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787865062.904561:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865062.904567:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904574:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865062.904578:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904586:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865062.904593:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865062.904599:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787865062.904642:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904648:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865062.904668:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904675:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a67 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.904689:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865062.904691:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865062.904693:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865062.904714:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087060864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865062.904741:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865062.904833:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087060736:0@lo:104: 00010000:00010000:1.0:1787865062.904852:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865062.905071:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060864 00000100:00100000:0.0:1787865062.905077:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060864 00010000:00010000:0.0:1787865062.905100:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 17 pid: 14367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865062.905140:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787865062.905148:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:3315:x1874712087060864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787865062.905158:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865062.905163:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 17 pid: 14367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905174:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 17 pid: 14367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905188:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b351000/0xa63eebe186192a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192a60 expref: 17 pid: 14367 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905201:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905219:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787865062.905232:0:14359:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001415816s 00010000:00010000:0.0:1787865062.905236:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905244:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905251:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905259:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905265:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865062.905270:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905277:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905299:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865062.905308:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865062.905343:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:3315:x1874712087060864:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865062.905350:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787865062.905384:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087060864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865062.905520:0:14388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.905529:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865062.905536:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa21336a000/0xa63eebe186192afa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865062.913838:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+15:15055:x1874712087060608:12345-0@lo:253:mount.lustre.0 Request processed in 29148us (29524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865062.913853:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787865062.914004:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15055:1874712087060608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787865062.914019:0:15055:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787865062.914023:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787865062.914024:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787865062.914025:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787865062.914027:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787865062.914028:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787865062.914029:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787865062.914030:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787865062.914032:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787865062.914034:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787865062.914050:0:15055:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787865062.919054:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865062.919229:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865062.919380:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865062.919760:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787865062.920050:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1787865062.920214:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787865062.921157:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787865062.972392:0:15055:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787865062.972416:0:15055:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787865062.972446:0:15055:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787865062.972510:0:15055:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787865062.972522:0:15055:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787865062.972548:0:15055:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787865063.547665:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787865063.868805:0:14404:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787865063.868814:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787865063.869481:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787865063.869554:0:14404:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787865063.869588:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1787865064.574168:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787865064.764614:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787865064.764622:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa105f5d800 from 7 10000000:01000000:2.0:1787865064.764626:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787865064.764672:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865064.764684:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865064.764695:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865064.764719:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087060992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787865064.764785:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865064.764834:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204de6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865064.765100:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087060992 00000100:00100000:0.0:1787865064.765107:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087060992 00000100:00100000:0.0:1787865064.765342:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787865064.765353:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+15:14369:x1874712087060992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865064.765366:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865064.765380:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192b01 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865064.765430:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192b01 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865064.765441:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b01 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865064.765455:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493600, rc 0) 00000100:00100000:0.0:1787865064.765509:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:14369:x1874712087060992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865064.765516:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787865064.768443:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087060992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865064.768589:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865064.768602:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865064.768669:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087061120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787865064.768732:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865064.768830:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20ddbf540 going to sleep for 11 seconds 00000100:00100000:2.0:1787865064.768878:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061120 00000100:00100000:2.0:1787865064.768884:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061120 00000100:00100000:2.0:1787865064.772680:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787865064.772696:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:14369:x1874712087061120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787865064.772722:0:14367:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787865064.772743:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787865064.772746:0:14367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787865064.772867:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:14369:x1874712087061120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865064.772874:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787865064.772933:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087061120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787865064.773142:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787865064.773151:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865064.773161:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865065.595589:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865066.619584:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865067.646416:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787865068.040159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787865068.040165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787865068.040168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787865068.040171:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787865068.040180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787865068.040199:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087061248:0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040276:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865068.040330:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061248 00000100:00100000:0.0:1787865068.040338:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061248 00000100:00100000:0.0:1787865068.040377:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787865068.040386:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:3315:x1874712087061248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040456:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:3315:x1874712087061248:12345-0@lo:400:kworker.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865068.040463:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787865068.040508:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087061248:0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040551:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087061376:0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040577:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865068.040609:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061376 00000100:00100000:0.0:1787865068.040613:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061376 00000100:00100000:0.0:1787865068.040637:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787865068.040644:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087061376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040678:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087061376:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865068.040684:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787865068.040711:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cc780 x1874712087061376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865068.040723:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087061376:0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040753:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087061504:0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040775:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865068.040802:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061504 00000100:00100000:0.0:1787865068.040805:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061504 00000100:00100000:0.0:1787865068.040845:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865068.040851:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087061504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865068.040884:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087061504:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865068.040889:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787865068.040915:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787865068.040931:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa20c1cc780 x1874712087061504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865068.040940:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087061504:0@lo:400:kworker.0 00000001:02000400:0.0:1787865068.318738:0:15424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787865068.667770:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865069.701547:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865070.717011:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865071.739678:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865072.769527:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787865073.087126:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787865073.159111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865073.159118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787865073.159120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865073.159124:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787865073.159133:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787865073.159153:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d7f3274-06f9-466a-8cc1-a9159491893b:3316:1874712087061632:0@lo:400:kworker.0 00000100:00100000:2.0:1787865073.159216:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865073.159270:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061632 00000100:00100000:2.0:1787865073.159276:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061632 00000100:00100000:2.0:1787865073.159317:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787865073.159326:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+16:3316:x1874712087061632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865073.159387:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+16:3316:x1874712087061632:12345-0@lo:400:kworker.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865073.160226:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787865073.160294:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d7f3274-06f9-466a-8cc1-a9159491893b:3316:1874712087061632:0@lo:400:kworker.0 00000100:00100000:1.0:1787865073.162735:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087061760:0@lo:400:kworker.0 00000100:00100000:1.0:1787865073.162794:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865073.167491:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787865073.167519:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087061888:0@lo:400:kworker.0 00000100:00100000:1.0:1787865073.172313:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865073.173357:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061760 00000100:00100000:1.0:1787865073.173368:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061760 00000100:00100000:1.0:1787865073.173434:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087061888 00000100:00100000:1.0:1787865073.173438:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087061888 00000100:00100000:1.0:1787865073.173467:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787865073.173476:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087061760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865073.173551:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874712087061760:12345-0@lo:400:kworker.0 Request processed in 76us (10757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865073.173558:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787865073.173694:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787865073.173703:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087061888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865073.173742:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874712087061888:12345-0@lo:400:kworker.0 Request processed in 41us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865073.173749:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787865073.173787:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa203edda40 x1874712087061888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865073.173802:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1874712087061888:0@lo:400:kworker.0 00010000:00080000:1.0:1787865073.174096:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa203edcb40 x1874712087061760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865073.174107:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874712087061760:0@lo:400:kworker.0 00000100:00080000:0.0:1787865073.174510:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787865073.788590:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865074.812461:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787865075.779491:0:15774:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787865075.779504:0:15774:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787865075.779858:0:15774:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa23b534000 00000020:01000004:3.0:1787865075.779875:0:15774:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787865075.779887:0:15774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787865075.779910:0:15774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa205893490) 00000020:00000080:3.0:1787865075.779925:0:15774:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787865075.819872:0:15774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787865075.820185:0:15774:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787865075.821181:0:15774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787865075.821524:0:15774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787865075.821738:0:15774:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787865075.822215:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:3.0:1787865075.822315:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:3.0:1787865075.822577:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:3.0:1787865075.823386:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1787865075.823754:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1787865075.824258:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1787865075.824706:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1787865075.824983:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1787865075.825372:0:15774:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:3.0:1787865075.826206:0:15774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787865075.826219:0:15774:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787865075.826229:0:15774:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa63eebe186192b16 00000020:01000004:3.0:1787865075.826238:0:15774:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787865075.826260:0:15774:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787865075.826263:0:15774:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787865075.826269:0:15774:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787865075.826291:0:15774:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787865075.826295:0:15774:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1787865075.835737:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787865075.849817:0:15774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787865075.849857:0:15774:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787865075.849862:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787865075.849864:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787865075.849865:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865075.849866:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865075.849867:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865075.849868:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865075.849870:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787865075.849872:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865075.849873:0:15774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787865075.849877:0:15774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787865075.849880:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787865075.849881:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787865075.849882:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865075.849883:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865075.849889:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865075.849890:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865075.849891:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787865075.849892:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865075.849893:0:15774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787865075.849919:0:15774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787865075.849944:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787865075.850372:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865075.850517:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa22e4b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.850611:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062016 00000100:00100000:2.0:1787865075.850620:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062016 00000100:00100000:2.0:1787865075.850673:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787865075.850682:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15774:x1874712087062016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787865075.850739:0:14367:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787865075.850743:0:14367:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787865075.850746:0:14367:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787865075.863626:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15774:x1874712087062016:12345-0@lo:253:mount.lustre.0 Request processed in 12935us (13246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.863641:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787865075.863748:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ce940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787865075.863764:0:15774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787865075.863767:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787865075.863769:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787865075.863770:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787865075.863786:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787865075.863787:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787865075.863788:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787865075.863790:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787865075.863792:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787865075.863794:0:15774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787865075.863815:0:15774:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa23b534000 from lustre-OST0001 10000000:01000000:1.0:1787865075.863842:0:15774:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787865075.863845:0:15774:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787865075.863852:0:15774:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa23b670000 local copy 00010000:00010000:1.0:1787865075.863862:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865075.864189:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.864232:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.864356:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.864573:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062144 00000100:00100000:0.0:1787865075.864579:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062144 00000100:00100000:0.0:1787865075.864626:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787865075.864635:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15774:x1874712087062144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865075.864940:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15774:x1874712087062144:12345-0@lo:501:mount.lustre.0 Request processed in 306us (706us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787865075.864948:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787865075.865008:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787865075.865106:0:15774:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787865075.865258:0:15774:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787865075.865266:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.865274:0:15774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211493200/0xa63eebe186192987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe18619298e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865075.865297:0:15774:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa23b534000 10000000:01000000:1.0:1787865075.865302:0:15774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787865075.865308:0:15774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787865075.865310:0:15774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787865075.865314:0:15774:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787865075.865317:0:15774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787865075.865348:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.865355:0:15774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.865364:0:15774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865075.865377:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865075.865568:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.865645:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.865690:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062272 00000100:00100000:0.0:1787865075.865695:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062272 00000100:00100000:0.0:1787865075.865769:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787865075.865777:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:15774:x1874712087062272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787865075.865789:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865075.865800:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493800/0xa63eebe186192b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192b1d expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865075.865821:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493800/0xa63eebe186192b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192b1d expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865075.865844:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493800/0xa63eebe186192b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b1d expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865075.865853:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493800, rc 0) 00000100:00100000:0.0:1787865075.865893:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062272:12345-0@lo:101:mount.lustre.0 Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.865899:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787865075.865960:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865075.865973:0:15774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b24 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.865982:0:15774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192b24 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865075.866800:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787865075.867988:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865075.870634:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787865075.870720:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787865075.870757:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787865075.870808:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787865075.870848:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787865075.870886:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787865075.871091:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787865075.871100:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787865075.871208:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.871287:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.871338:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51300 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.871698:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062400 00000100:00100000:0.0:1787865075.871706:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062400 00000100:00100000:0.0:1787865075.871807:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787865075.871817:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865075.872245:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062400:12345-0@lo:501:mount.lustre.0 Request processed in 429us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.872254:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787865075.872440:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.872481:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865075.872528:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.878747:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51300 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.878886:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062528 00000100:00100000:2.0:1787865075.878895:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062528 00000100:00100000:2.0:1787865075.878949:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787865075.878972:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865075.879376:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062528:12345-0@lo:503:mount.lustre.0 Request processed in 405us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.879421:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787865075.879649:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062528:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787865075.880254:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787865075.880330:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865075.880384:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.880836:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203758840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.881194:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062656 00000100:00100000:0.0:1787865075.881201:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062656 00000100:00100000:0.0:1787865075.881243:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787865075.881251:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865075.881507:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062656:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.881516:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787865075.881740:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865075.882230:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787865075.882280:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787865075.882310:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787865075.882368:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787865075.882521:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787865075.882557:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787865075.882609:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787865075.882645:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787865075.882711:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787865075.882748:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865075.882801:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.882832:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa203758840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.882914:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062784 00000100:00100000:0.0:1787865075.882919:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062784 00000100:00100000:0.0:1787865075.883068:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787865075.883078:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865075.883256:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062784:12345-0@lo:502:mount.lustre.0 Request processed in 179us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.883271:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787865075.883348:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865075.883452:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787865075.883468:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787865075.884940:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787865075.885105:0:15776:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787865075.885113:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.885116:0:15776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787865075.885123:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787865075.885139:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa210db0000) 00000020:00000080:1.0:1787865075.885176:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787865075.885183:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787865075.885239:0:15776:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa23b534000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787865075.885246:0:15776:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787865075.885252:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa63eebe186192b32 00010000:00010000:1.0:1787865075.889125:0:15776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787865075.889768:0:15776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787865075.891826:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1787865075.894823:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787865075.894836:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787865075.894843:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865075.894845:0:15776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787865075.894849:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787865075.894852:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865075.894854:0:15776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787865075.894857:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787865075.894859:0:15776:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787865075.894861:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787865075.894863:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865075.894865:0:15776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787865075.894867:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787865075.894869:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865075.894870:0:15776:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787865075.894873:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787865075.894923:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787865075.894926:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787865075.894928:0:15776:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787865075.894931:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787865075.895119:0:15774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787865075.895142:0:15774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787865075.895160:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b24 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.895173:0:15774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336be00/0xa63eebe186192b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b24 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865075.895181:0:15774:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23b534000 from 1 10000000:01000000:1.0:1787865075.895184:0:15774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787865075.895217:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.895225:0:15774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.895235:0:15774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865075.895264:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787865075.895322:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.899437:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2199ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.899597:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087062912 00000100:00100000:2.0:1787865075.899607:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087062912 00000100:00100000:2.0:1787865075.899665:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787865075.899676:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+17:15774:x1874712087062912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865075.899693:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865075.899710:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192b39 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.899736:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192b39 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.899748:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b39 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.899758:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581200, rc 0) 00000100:00100000:2.0:1787865075.899814:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087062912:12345-0@lo:101:mount.lustre.0 Request processed in 140us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.899821:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787865075.900000:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087062912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865075.900016:0:15774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.900025:0:15774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865075.900721:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787865075.901011:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865075.901356:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787865075.902299:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787865075.902627:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787865075.902637:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787865075.902732:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.902805:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.902883:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2199ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.905793:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063040 00000100:00100000:0.0:1787865075.905804:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063040 00000100:00100000:0.0:1787865075.905903:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787865075.905914:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787865075.906222:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063040:12345-0@lo:501:mount.lustre.0 Request processed in 309us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.906231:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787865075.906316:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.906366:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865075.906454:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.906731:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.906881:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063168 00000100:00100000:2.0:1787865075.906887:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063168 00000100:00100000:2.0:1787865075.906931:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787865075.906940:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865075.907273:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063168:12345-0@lo:503:mount.lustre.0 Request processed in 334us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.907279:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787865075.907642:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787865075.908157:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787865075.908247:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865075.908305:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.908336:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2199ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.909042:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063296 00000100:00100000:2.0:1787865075.909072:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063296 00000100:00100000:2.0:1787865075.909108:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787865075.909116:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865075.909351:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063296:12345-0@lo:502:mount.lustre.0 Request processed in 235us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.909359:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787865075.909556:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865075.909833:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787865075.909880:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787865075.909928:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787865075.909962:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787865075.909991:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787865075.910030:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787865075.910074:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787865075.910106:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787865075.910139:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787865075.910187:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865075.910213:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23be51780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865075.910279:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063424 00000100:00100000:0.0:1787865075.910285:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063424 00000100:00100000:0.0:1787865075.910314:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787865075.910321:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787865075.910509:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063424:12345-0@lo:502:mount.lustre.0 Request processed in 188us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865075.910516:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787865075.910665:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f559e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787865075.910748:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787865075.910758:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787865075.911934:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787865075.911945:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.911947:0:15780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787865075.911953:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa23b534000 00000020:00000080:1.0:1787865075.911955:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787865075.911962:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865075.911964:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.911966:0:15780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787865075.911968:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787865075.911971:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.911972:0:15780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787865075.911975:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa23b534000 00000020:00000080:1.0:1787865075.911984:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787865075.912038:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865075.912042:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.912044:0:15780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787865075.912047:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787865075.912050:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.912051:0:15780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787865075.912068:0:15780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa23b534000 00000020:00000080:1.0:1787865075.912070:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787865075.912108:0:15780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787865075.912112:0:15780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787865075.912113:0:15780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787865075.912116:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787865075.912250:0:15774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787865075.912274:0:15774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787865075.912300:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.912311:0:15774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865075.912353:0:15774:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787865075.912355:0:15774:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa23b534000 10000000:01000000:2.0:1787865075.912358:0:15774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa23b534000 10000000:01000000:2.0:1787865075.912362:0:15774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787865075.912367:0:15774:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa23b534000 from 1 10000000:01000000:2.0:1787865075.912370:0:15774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787865075.912436:0:15774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.912444:0:15774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.912455:0:15774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865075.912481:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787865075.912563:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.912596:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa212013240 going to sleep for 11 seconds 00000100:00100000:1.0:1787865075.917466:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063552 00000100:00100000:1.0:1787865075.917482:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063552 00000100:00100000:1.0:1787865075.917543:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787865075.917553:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087063552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787865075.917569:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865075.917585:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21336a000/0xa63eebe186192b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192b47 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.917611:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21336a000/0xa63eebe186192b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192b47 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.917622:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21336a000/0xa63eebe186192b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b47 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865075.917631:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21336a000, rc 0) 00000100:00100000:1.0:1787865075.917701:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063552:12345-0@lo:101:mount.lustre.0 Request processed in 149us (5137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865075.917708:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787865075.918546:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787865075.918566:0:15774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b4e expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865075.918578:0:15774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192b4e expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787865075.919124:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787865075.919501:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787865075.919721:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787865075.919762:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787865075.919795:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787865075.919841:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787865075.919876:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787865075.919920:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787865075.919966:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787865075.919997:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787865075.920073:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787865075.920106:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787865075.920141:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787865075.920190:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787865075.920227:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787865075.920258:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787865075.920318:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787865075.920355:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787865075.920388:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787865075.920469:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787865075.920505:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787865075.920534:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787865075.920592:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787865075.920628:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787865075.920662:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787865075.920705:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787865075.920756:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787865075.920791:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787865075.920838:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787865075.920874:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787865075.920907:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787865075.920951:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787865075.920986:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787865075.921021:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787865075.921069:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787865075.921117:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787865075.921153:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787865075.921201:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787865075.921239:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787865075.928476:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787865075.928499:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787865075.928601:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865075.928669:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.928707:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa212013240 going to sleep for 11 seconds 00000100:00100000:1.0:1787865075.929554:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063680 00000100:00100000:1.0:1787865075.929565:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063680 00000100:00100000:1.0:1787865075.929618:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787865075.929627:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787865075.929908:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063680:12345-0@lo:501:mount.lustre.0 Request processed in 280us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865075.929917:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787865075.930095:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787865075.930140:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787865075.930186:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.930225:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa212013240 going to sleep for 11 seconds 00000100:00100000:1.0:1787865075.930892:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063808 00000100:00100000:1.0:1787865075.930900:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063808 00000100:00100000:1.0:1787865075.930938:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787865075.930946:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa106e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787865075.931263:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa106e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063808:12345-0@lo:503:mount.lustre.0 Request processed in 316us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865075.931271:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787865075.931375:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063808:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787865075.931945:0:15774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787865075.932037:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865075.932110:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.932153:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087063936 00000100:00100000:2.0:1787865075.932158:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087063936 00000100:00100000:2.0:1787865075.932191:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787865075.932199:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865075.932464:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087063936:12345-0@lo:502:mount.lustre.0 Request processed in 265us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.932471:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787865075.932518:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa212013240 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.932532:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087063936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787865075.932728:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787865075.932774:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787865075.932809:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787865075.932856:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787865075.932893:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787865075.932944:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787865075.932981:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787865075.933017:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787865075.933080:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787865075.933118:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787865075.933154:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787865075.933201:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787865075.933238:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787865075.933274:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787865075.933324:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787865075.933383:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787865075.933448:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787865075.933510:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787865075.933549:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787865075.933591:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787865075.933633:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787865075.933667:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787865075.933701:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787865075.933750:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787865075.933790:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787865075.933827:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787865075.933875:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787865075.933912:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787865075.933945:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787865075.933987:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787865075.934024:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787865075.934093:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787865075.934128:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787865075.934177:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787865075.946247:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787865075.946326:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787865075.946362:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787865075.946487:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787865075.946539:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787865075.946578:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787865075.946629:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087064064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865075.946712:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.946758:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064064 00000100:00100000:2.0:1787865075.946764:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064064 00000100:00100000:2.0:1787865075.946879:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787865075.946888:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087064064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787865075.947521:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087064064:12345-0@lo:502:mount.lustre.0 Request processed in 633us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.947530:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787865075.947587:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa212013240 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.947606:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087064064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787865075.947681:0:15774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787865075.947692:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787865075.964132:0:15785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787865075.964150:0:15785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa212c93490) 00000020:00000080:2.0:1787865075.964172:0:15785:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787865075.964266:0:15785:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa23b534000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787865075.964271:0:15785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa23b534000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787865075.966963:0:15785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa23b534000 3 00010000:00080000:2.0:1787865075.967012:0:15785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa23b390000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787865075.968676:0:15785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787865075.968890:0:15785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787865075.968933:0:15785:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787865075.968947:0:15785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa63eebe186192b5c 00000100:00080000:2.0:1787865075.968958:0:15785:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787865075.968963:0:15785:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa23b390000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787865075.968996:0:15785:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa1075d6d00 x1874712087064192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787865075.969028:0:15785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787865075.969073:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865075.969078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787865075.969081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787865075.969083:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787865075.969143:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087064320:0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.969207:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.969269:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087064448:0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.969293:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.969327:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064320 00000100:00100000:2.0:1787865075.969333:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064320 00000100:00100000:1.0:1787865075.970563:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087064192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787865075.970618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865075.976922:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064448 00000100:00100000:2.0:1787865075.976936:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064448 00000100:00100000:2.0:1787865075.977008:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064192 00000100:00100000:2.0:1787865075.977011:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064192 00000100:00100000:2.0:1787865075.977026:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787865075.977036:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087064320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.977136:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087064320:12345-0@lo:400:kworker.0 Request processed in 102us (7929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.977143:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787865075.977186:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa1075d4000 x1874712087064320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865075.977199:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087064320:0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.977243:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787865075.977249:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087064448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.977279:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087064448:12345-0@lo:400:kworker.0 Request processed in 31us (7985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.977284:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787865075.977303:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa1075d43c0 x1874712087064448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865075.977312:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087064448:0@lo:400:kworker.0 00000100:00100000:2.0:1787865075.977327:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787865075.977330:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1874712087064192:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787865075.977357:0:14373:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:2.0:1787865075.977429:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa63eebe186192b63 00000004:00100000:2.0:1787865075.977446:0:14373:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787865075.977477:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9fa204dbf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787865075.977521:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f559e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874712087064192:12345-0@lo:38:llog_process_th.0 Request processed in 187us (6901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865075.977528:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787865075.977559:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa1075d6d00 x1874712087064192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787865085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865075.977569:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787865075.977575:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787865075.977582:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787865075.977586:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787865075.977589:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23b390000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787865075.977594:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1874712087064192:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787865075.979961:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787865075.980242:0:15785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787865075.980703:0:15774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787865075.980731:0:15774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787865075.980756:0:15774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b4e expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865075.980767:0:15774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa203580000/0xa63eebe186192b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192b4e expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787865075.980816:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787865075.980818:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787865075.980823:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865075.980824:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865075.980825:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865075.980826:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865075.980828:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787865075.980829:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865075.980830:0:15774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787865075.980833:0:15774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787865075.980835:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787865075.980837:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787865075.980838:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865075.980838:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865075.980839:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865075.980840:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865075.980841:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787865075.980842:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865075.980843:0:15774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787865075.980866:0:15774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787865075.980887:0:15774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087064576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787865075.980957:0:15774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865075.980998:0:15774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204f21240 going to sleep for 11 seconds 00000100:00100000:2.0:1787865075.983664:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064576 00000100:00100000:2.0:1787865075.983675:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064576 00000100:00100000:2.0:1787865075.984018:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787865075.984029:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+19:15774:x1874712087064576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787865075.984071:0:14365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787865075.984085:0:14365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787865076.034511:0:14365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787865076.034532:0:14365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787865076.034604:0:14388:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787865076.034608:0:14388:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787865076.034631:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865076.034651:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b01 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865076.034674:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865076.034714:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865076.034728:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 19 pid: 14365 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865076.034742:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087064704:0@lo:104: 00000100:00100000:2.0:1787865076.034808:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865076.034870:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa107342000 going to sleep for 11 seconds 00000100:00100000:0.0:1787865076.034938:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064704 00000100:00100000:0.0:1787865076.034945:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064704 00000100:00100000:0.0:1787865076.034996:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865076.035015:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087064704:12345-0@lo:104: 00010000:00010000:0.0:1787865076.035027:0:14356:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865076.035090:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787865076.035097:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d7f3274-06f9-466a-8cc1-a9159491893b+3:14388:x1874712087064704:12345-0@lo:104: Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865076.035103:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865076.035159:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14388:1874712087064704:0@lo:104: 00010000:00010000:0.0:1787865076.035180:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035431:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865076.035439:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035447:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:1.0:1787865076.035452:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035461:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787865076.035469:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787865076.035481:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787865076.035509:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035516:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787865076.035533:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035540:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa203581600/0xa63eebe186192b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b08 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035556:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865076.035558:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865076.035560:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865076.035578:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d7f3274-06f9-466a-8cc1-a9159491893b:3316:1874712087064832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865076.035608:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865076.035652:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064832 00000100:00100000:1.0:1787865076.035656:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064832 00010000:00010000:1.0:1787865076.035677:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 20 pid: 14365 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865076.035700:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787865076.035707:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+20:3316:x1874712087064832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787865076.035717:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865076.035722:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 20 pid: 14365 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035732:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 20 pid: 14365 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035752:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa211493600/0xa63eebe186192b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192b01 expref: 20 pid: 14365 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035765:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035772:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787865076.035784:0:14359:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001415816s 00010000:00010000:1.0:1787865076.035788:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035795:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035802:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035808:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035813:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865076.035816:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035824:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035839:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035855:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865076.035887:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3316:x1874712087064832:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.035893:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787865076.035916:0:14388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035924:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865076.035930:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa203580e00/0xa63eebe186192b6a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865076.035953:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d7f3274-06f9-466a-8cc1-a9159491893b:3316:1874712087064832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787865076.051770:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:15774:x1874712087064576:12345-0@lo:253:mount.lustre.0 Request processed in 67734us (70803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.051785:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787865076.051875:0:15774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d7f3274-06f9-466a-8cc1-a9159491893b:15774:1874712087064576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787865076.051893:0:15774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787865076.051897:0:15774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787865076.051899:0:15774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787865076.051900:0:15774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787865076.051901:0:15774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787865076.051903:0:15774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787865076.051904:0:15774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787865076.051906:0:15774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787865076.051908:0:15774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787865076.051910:0:15774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787865076.051925:0:15774:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787865076.057272:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787865076.057593:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787865076.057842:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787865076.058001:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787865076.058380:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1787865076.058967:0:15774:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787865076.059832:0:15774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787865076.114545:0:15774:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787865076.114554:0:15774:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787865076.114587:0:15774:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787865076.114661:0:15774:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787865076.114676:0:15774:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787865076.114704:0:15774:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787865076.859728:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865076.987514:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787865061/real 1787865061] req@ffff9fa20c1cc3c0 x1874712087057664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865076.987545:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa20c1cc3c0 x1874712087057664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787865076.987625:0:3314:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787865061/real 1787865061] req@ffff9fa20c1ce580 x1874712087057792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787865076.987640:0:3314:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa20c1ce580 x1874712087057792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787865076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787865076.987659:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787865076.987685:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787865076.987689:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087057664:0@lo:8:kworker.0 00000100:00080000:3.0:1787865076.987695:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd34800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787865076.987700:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787865076.987703:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087057792:0@lo:8:kworker.0 00000100:00080000:1.0:1787865076.987835:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787865076.987847:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787865076.987850:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787865076.987855:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 377 00000100:00080000:1.0:1787865076.987860:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787865076.987867:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa203fd2800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787865076.987886:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f55ad00 x1874712087065088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787865076.987900:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787865076.987903:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787865076.987904:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd34800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787865076.987907:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 377 00000100:00080000:1.0:1787865076.987910:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787865076.987913:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa23fd34800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787865076.987923:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa22f5583c0 x1874712087065216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787865076.987970:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087065472:0@lo:400:kworker.0 00000100:00100000:1.0:1787865076.988033:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865076.988096:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787865076.988103:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087065600:0@lo:400:kworker.0 00000100:00100000:1.0:1787865076.988125:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865076.988157:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065472 00000100:00100000:1.0:1787865076.988163:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065472 00000100:00100000:1.0:1787865076.988209:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065600 00000100:00100000:1.0:1787865076.988212:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065600 00000100:00100000:1.0:1787865076.988239:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787865076.988246:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865076.988292:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087065472:12345-0@lo:400:kworker.0 Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.988300:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787865076.988315:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787865076.988321:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865076.988347:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087065600:12345-0@lo:400:kworker.0 Request processed in 26us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.988353:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787865076.988367:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787865076.988427:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f5592c0 x1874712087065600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865076.988438:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087065600:0@lo:400:kworker.0 00010000:00080000:1.0:1787865076.988450:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f55b840 x1874712087065472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865076.988458:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087065472:0@lo:400:kworker.0 00000100:00100000:1.0:1787865076.988477:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087065088:0@lo:8:kworker.0 00000100:00100000:1.0:1787865076.988504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865076.988527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087065216:0@lo:8:kworker.0 00000100:00100000:1.0:1787865076.988546:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865076.988576:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065088 00000100:00100000:1.0:1787865076.988580:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065088 00000100:00100000:1.0:1787865076.988601:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065216 00000100:00100000:1.0:1787865076.988603:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065216 00000100:00100000:1.0:1787865076.988614:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865076.988618:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1874712087065088:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787865076.988639:0:15056:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:1.0:1787865076.988664:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186192b71 00000100:00100000:2.0:1787865076.988795:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f55a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d7f3274-06f9-466a-8cc1-a9159491893b:3317:1874712087064960:0@lo:400:kworker.0 00000100:00100000:2.0:1787865076.988831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865076.988869:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787865076.988875:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087065344:0@lo:400:kworker.0 00000100:00100000:2.0:1787865076.988898:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865076.988926:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087064960 00000100:00100000:2.0:1787865076.988930:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087064960 00000100:00100000:2.0:1787865076.988954:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787865076.988960:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:3317:x1874712087064960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865076.988992:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:3317:x1874712087064960:12345-0@lo:400:kworker.0 Request processed in 32us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865076.989005:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787865076.989038:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d7f3274-06f9-466a-8cc1-a9159491893b:3317:1874712087064960:0@lo:400:kworker.0 00002000:00100000:1.0:1787865076.989191:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa203201800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787865076.989196:0:15056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787865076.989199:0:15056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787865076.989592:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065344 00000100:00100000:2.0:1787865076.989608:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065344 00000100:00100000:2.0:1787865076.989629:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787865076.989636:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087065344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865076.989684:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087065344:12345-0@lo:400:kworker.0 Request processed in 47us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865076.989690:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787865076.989717:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f558000 x1874712087065344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865076.989728:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087065344:0@lo:400:kworker.0 00002000:00080000:1.0:1787865076.990035:0:15056:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787865076.990073:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9fa203205000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787865076.990127:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874712087065088:12345-0@lo:8:kworker.0 Request processed in 1508us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.990135:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865076.990151:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865076.990155:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f5592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1874712087065216:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787865076.990175:0:15056:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:1.0:1787865076.990197:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa63eebe186192b78 00002000:00100000:1.0:1787865076.990207:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa203203000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787865076.990210:0:15056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787865076.990212:0:15056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1787865076.990584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f55ad00 x1874712087065088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787865096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787865076.990595:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787865076.990617:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787865076.990625:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787865076.990630:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787865076.990633:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa203fd2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787865076.990647:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787865076.990656:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f55ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087065088:0@lo:8:kworker.0 00000004:00080000:2.0:1787865076.990680:0:14394:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787865076.991185:0:14394:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392930787038ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787865076.991373:0:14395:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787865076.991430:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14395:1874712087065856:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787865076.991481:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865076.991507:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa202f8b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787865076.991539:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787865076.991549:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087065728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787865076.991575:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865076.991759:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787865076.991766:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787865076.992066:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065728 00000100:00100000:3.0:1787865076.992073:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065728 00000100:00100000:3.0:1787865076.992119:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787865076.992129:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087065728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787865076.992157:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787865076.992205:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874712087065728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865076.992212:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787865076.992249:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa203ede940 x1874712087065728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787865092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787865076.992265:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203ede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087065728:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787865076.995069:0:15056:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787865076.995105:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9fa203207000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787865076.995193:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f5592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874712087065216:12345-0@lo:8:kworker.0 Request processed in 5035us (6644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865076.995204:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865076.995246:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065856 00000100:00100000:1.0:1787865076.995253:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065856 00000100:00100000:1.0:1787865076.995288:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787865076.995296:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14395:x1874712087065856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787865077.002006:0:15056:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787865077.002018:0:15056:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787865077.002025:0:15056:0:(ofd_dev.c:1495:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:0.0:1787865077.009513:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787865077.009724:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa22f5583c0 x1874712087065216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787865096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865077.009737:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787865077.009747:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787865077.009756:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787865077.009762:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787865077.009765:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9fa23fd34800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787865077.009779:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787865077.009785:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1874712087065216:0@lo:8:kworker.0 00000004:00080000:0.0:1787865077.009826:0:14396:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787865077.013360:0:14396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392952960998ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787865077.014002:0:14397:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787865077.014035:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14397:1874712087066112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787865077.014107:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865077.014133:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204f219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865077.014149:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787865077.014160:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787865077.014184:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865077.015963:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066112 00000100:00100000:3.0:1787865077.015975:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066112 00000100:00100000:3.0:1787865077.016036:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787865077.016057:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14397:x1874712087066112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787865077.028775:0:15059:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787865077.028786:0:15059:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787865077.028797:0:15059:0:(ofd_dev.c:1495:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:2.0:1787865077.028973:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787865077.029004:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087065984 00000100:00100000:2.0:1787865077.029013:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087065984 00000100:00100000:2.0:1787865077.029082:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787865077.029092:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874712087065984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787865077.029116:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787865077.029197:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874712087065984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (15012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865077.029205:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00010000:1.0:1787865077.029595:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.029604:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029621:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.029626:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.029632:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029651:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029661:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029669:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029684:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.029698:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.029704:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029719:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.029723:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029731:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029747:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029755:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192b7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.029773:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.029775:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.029777:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787865077.030334:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cf480 x1874712087065984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787865093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865077.030357:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087065984:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1787865077.040013:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.040027:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040059:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.040065:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.040073:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040087:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040106:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040114:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040143:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787865077.040583:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.040590:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040599:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.040602:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.040606:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040616:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040624:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040630:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040657:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787865077.040673:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787865077.040679:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040687:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336ba00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.040690:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040699:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040715:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040722:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac1e7768/0xa63eebe186192b86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040738:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.040741:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040748:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.040751:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040770:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040781:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040787:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b92341a/0xa63eebe186192b8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.040801:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.040803:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.040804:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.041111:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.051286:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.051302:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.051319:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.051324:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.051331:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.051346:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.051357:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.051375:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.051432:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787865077.051709:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787865077.051717:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.051727:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865077.051732:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.051742:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.051763:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.051772:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001613d570/0xa63eebe186192b94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.051804:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.051806:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.051808:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.052974:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.052984:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.052999:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.053003:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.053010:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053022:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053030:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053036:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053110:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787865077.053642:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.053649:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053667:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.053670:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.053674:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053684:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053693:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.053711:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787865077.054974:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.054983:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.054996:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1787865077.055000:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.055005:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.055021:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.055075:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.055084:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058270:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787865077.058283:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058297:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865077.058302:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058314:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058335:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058344:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97c99c1/0xa63eebe186192b9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058368:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787865077.058372:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058378:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865077.058415:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058425:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058436:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058444:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787865077.058449:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058456:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865077.058460:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058468:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058480:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.058487:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.058488:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.058491:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.062739:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787865077.062755:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9d1306/0xa63eebe186192ba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.062975:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.064016:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.064025:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.064041:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.064045:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.064063:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.064090:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.064101:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.064108:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.064871:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787865077.066371:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.066472:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.066490:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787865077.066494:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.066501:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.066515:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.066524:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.066543:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.066568:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787865077.066587:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787865077.066594:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.066890:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.066897:0:15059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192ba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068360:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.068367:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068378:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068482:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068489:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe92715/0xa63eebe186192bb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068512:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.068517:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068540:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200030800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.068543:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068550:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068561:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068567:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54b8702/0xa63eebe186192bb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.068579:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.068581:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.068583:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.073941:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.075659:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.075672:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075689:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.075694:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.075868:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075884:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075906:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075914:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075931:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.075944:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.075949:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075957:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.075961:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075970:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075987:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.075995:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5256564/0xa63eebe186192bbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076014:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.076021:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.076023:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.076644:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.076651:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076661:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.076664:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.076669:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076679:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076686:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076692:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076722:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.076733:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.076738:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076745:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.076748:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076767:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076779:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076787:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e785b76/0xa63eebe186192bc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.076801:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.076803:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.076804:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.077206:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.077213:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077221:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.077224:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.077229:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077238:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077246:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077259:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077274:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.077284:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.077288:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077295:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa200031400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.077298:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077305:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077316:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077324:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000679776c0/0xa63eebe186192bcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077336:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.077337:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.077339:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.077748:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.077762:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077771:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.077775:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.077779:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.077788:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787865077.078900:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.078910:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.078935:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.078939:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.078944:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.078957:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.078967:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.078975:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.079003:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787865077.080901:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.080911:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.080929:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.080934:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.080939:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.080952:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.080972:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.080979:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081000:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787865077.081459:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.081465:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081474:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.081477:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.081481:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081489:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081497:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081504:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081522:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787865077.081914:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.081919:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081927:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.081930:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.081934:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081942:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081950:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081956:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.081964:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787865077.082339:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.082345:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082354:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.082363:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.082368:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082377:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082384:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082391:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082429:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787865077.082810:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.082816:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082824:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.082827:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.082831:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082842:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082851:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082865:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.082872:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787865077.083235:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.083241:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.083250:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.083253:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.083258:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.083267:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.083275:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.083281:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.083287:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1787865077.083617:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083625:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083647:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787865077.083653:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083660:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.083665:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083673:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083712:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083720:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb90453b/0xa63eebe186192bda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083742:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787865077.083745:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083752:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.083756:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083763:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083773:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083781:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221e25f4/0xa63eebe186192be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083791:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787865077.083794:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083807:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.083810:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083818:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083828:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083979:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa91bdb8/0xa63eebe186192be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.083995:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787865077.083999:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084004:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.084007:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084014:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084025:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084039:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb805597/0xa63eebe186192bef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084060:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787865077.084064:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084070:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.084073:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084080:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084090:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084096:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2eadae7/0xa63eebe186192bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084107:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787865077.084110:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084116:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.084124:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084131:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084141:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084147:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008faa582d/0xa63eebe186192bfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084158:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.084161:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084166:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.084169:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084175:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084182:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084188:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9f64d40/0xa63eebe186192c04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084205:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084207:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084267:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084279:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084295:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.084306:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.084310:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084317:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.084320:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084327:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084338:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084344:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45ad9dd/0xa63eebe186192bd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.084359:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084361:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.084363:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.087528:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.087545:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087564:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.087568:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.087575:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087588:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087598:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087606:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087628:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.087645:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.087650:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087658:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.087662:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087671:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087698:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087706:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.087722:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.087724:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.087726:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.088367:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.088375:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088472:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.088476:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.088482:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088494:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088503:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088511:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088538:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.088549:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.088554:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088561:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.088564:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088573:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088586:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088594:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.088608:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.088610:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.088611:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.091548:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.091559:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.091580:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.091585:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.091591:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.091605:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.091615:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.091622:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.091645:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.092024:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.092032:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.092041:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.092063:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.092073:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.092090:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.092098:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000807b531d/0xa63eebe186192c19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.092116:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.092117:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.092119:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.092432:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.092439:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.092447:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.092451:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.092456:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.092465:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.092483:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.092490:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.092508:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.093309:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.093318:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.093328:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.093332:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.093342:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.093357:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.093370:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.093387:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.093388:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.093390:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.095494:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.095508:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.095524:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.095529:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.095535:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.095549:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.095560:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.095567:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.095605:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.096975:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.096985:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.096997:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.097002:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.097013:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.097033:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.097040:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.097069:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.097071:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.097073:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.104638:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.104654:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.104672:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.104677:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.104683:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.104699:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.104711:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.104719:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.105938:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.105949:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.105961:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.105966:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.105976:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.105996:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.106005:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.106007:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.106008:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.106310:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787865077.106318:0:15059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787865077.109628:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.109642:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.109660:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.109664:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.109670:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.109684:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.109694:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.109703:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.109722:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.110366:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.110375:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.110416:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.110421:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.110430:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.110446:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.110454:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4326a95/0xa63eebe186192c35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.110471:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.110472:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.110474:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.117121:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.117133:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117149:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.117154:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.117160:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117174:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117196:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117203:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117220:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.117233:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.117239:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117246:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.117251:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117260:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117277:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117284:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192c3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.117298:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.117305:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.117307:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.117844:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.117852:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117868:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.117871:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.117876:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117887:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117895:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117902:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117919:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787865077.117930:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865077.117934:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117942:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.117946:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117953:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117981:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.117988:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192c43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118002:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.118003:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.118005:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.118525:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.118532:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118541:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.118544:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.118548:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118557:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118565:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118573:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.118604:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787865077.119014:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.119020:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119030:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.119033:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.119037:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119058:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119068:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119075:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119089:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787865077.119101:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787865077.119107:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119114:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.119123:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119133:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119147:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119154:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192c4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119194:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865077.119197:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119205:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.119208:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119216:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119226:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119234:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192c51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119253:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.119255:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.119256:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.119683:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.119690:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119699:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.119702:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.119706:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119717:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119725:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119732:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119747:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787865077.119756:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865077.119760:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119780:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.119784:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119793:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119807:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119814:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192c58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.119828:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.119829:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.119831:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.120272:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.120279:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.120288:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.120291:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.120295:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.120305:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.120318:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.120325:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.120338:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.124693:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.124708:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.124722:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.124726:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.124738:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.124764:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.124772:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022cb4e67/0xa63eebe186192c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.124802:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.124804:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.124806:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.125714:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.125724:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.125739:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.125744:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.125757:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.125772:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.125781:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.125789:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.125921:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787865077.126512:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.126520:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.126531:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.126535:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.126540:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.126551:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.126559:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.126582:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129841:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787865077.129860:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129875:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.129887:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129901:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129927:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129934:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192c66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129954:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.129958:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129965:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177be00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.129968:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129975:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129985:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.129992:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.129999:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.130001:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.133184:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.133198:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133227:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.133233:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.133240:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133254:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133264:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133271:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133295:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.133309:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.133315:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133322:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.133326:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133348:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133364:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133372:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8c122b8/0xa63eebe186192c74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133421:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.133423:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.133426:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.133821:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.133828:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133837:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.133841:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.133845:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133855:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133864:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133883:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133898:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.133906:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.133910:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133918:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.133922:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133930:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133943:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133951:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ed0373/0xa63eebe186192c7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.133964:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.133966:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.133968:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.134354:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.134367:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134376:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.134380:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.134385:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134416:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134426:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134434:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134448:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.134456:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.134459:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134466:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.134469:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134477:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134494:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134501:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007266b45b/0xa63eebe186192c82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134515:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.134517:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.134518:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.134915:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.134921:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134929:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.134932:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.134936:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134945:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134953:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134960:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.134985:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787865077.134995:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.134998:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.135005:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.135009:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.135016:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.135027:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.135033:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd5dff2/0xa63eebe186192c89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.135057:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.135058:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.135060:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.136758:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787865077.136769:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192c6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787865077.137763:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787865077.138350:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.141465:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.141479:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.141495:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.141500:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.141507:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.141521:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.141530:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.141538:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.141573:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787865077.142967:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865077.142978:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.142992:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.142997:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.143008:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.143033:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.143041:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdb4b460/0xa63eebe186192c90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.143092:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.143094:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.143096:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787865077.144124:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787865077.144137:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.144154:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787865077.144167:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865077.144174:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.144190:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.144201:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.144209:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.144774:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787865077.146117:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865077.146131:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.146143:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.146148:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.146160:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.146196:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.146204:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d0c42d/0xa63eebe186192c97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787865077.146321:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.146329:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.146340:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.146344:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.146351:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.146362:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.146370:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.146377:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.147331:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.147334:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.147336:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.148588:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.148607:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.148619:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.148626:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.148638:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.148651:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.148663:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.148681:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.148689:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192c9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.148706:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.148708:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.148710:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.154337:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.154349:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.154367:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.154372:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.154621:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.154639:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.154650:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.154669:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.154692:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787865077.155335:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.155345:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.155369:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.155373:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.155378:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155483:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865077.155491:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155500:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177be00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865077.155504:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155514:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155531:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155551:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086370759/0xa63eebe186192cac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865077.155570:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.155572:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865077.155574:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.155944:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.155953:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.155962:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.155984:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.156322:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.156329:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.156337:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.156341:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.156349:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.156362:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.156368:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a50dab1/0xa63eebe186192ca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.156411:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.156413:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.156415:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.159333:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.159356:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.159373:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.159933:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.159943:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.159959:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.159969:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.159977:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160004:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.160023:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.160030:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160038:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.160043:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160064:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160089:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160098:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192cb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.160115:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.160117:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.160119:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.160315:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.160323:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.160332:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.160335:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.160340:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.160351:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.160370:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.160378:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.160588:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.161097:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.161104:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.161111:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.161115:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.161123:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.161138:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.161145:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f51a634/0xa63eebe186192cba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.161175:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.161176:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.161178:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787865077.165361:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.165373:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165425:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.165430:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.165438:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165452:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165463:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165471:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165509:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787865077.165961:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.165967:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165976:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.165979:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.165983:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165992:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.165999:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.166006:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.166031:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787865077.166443:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787865077.166451:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166460:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.166464:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166474:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166491:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166500:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000761c2c0c/0xa63eebe186192cc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166516:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.166519:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166526:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580c00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.166537:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166545:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166556:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166563:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f84499/0xa63eebe186192cc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166576:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.166578:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.166579:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.166767:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.166773:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166783:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.166786:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.166790:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166799:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166805:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166818:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166832:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.166856:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.166860:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166866:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.166869:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166876:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166886:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166892:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192ccf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.166904:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.166905:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.166906:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.167492:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.167506:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167515:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.167518:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.167522:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167531:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167539:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167546:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167560:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.167569:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.167573:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167580:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177bc00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.167583:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167590:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167607:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167615:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aabadf7/0xa63eebe186192cd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.167628:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.167630:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.167631:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.168426:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.168775:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.168782:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.168795:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.168798:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.168804:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.168815:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.168824:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.168831:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787865077.169697:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787865077.169705:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.169715:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787865077.169724:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865077.169729:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.169739:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.169747:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.169753:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.169768:0:15059:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787865077.170675:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787865077.170685:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.170695:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865077.170699:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.170708:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.170725:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.170732:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453f3d89/0xa63eebe186192ce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.170754:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.170756:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787865077.170757:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.171081:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.171094:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.171099:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.171106:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.171109:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.171116:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.171128:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.171134:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e98e8c89/0xa63eebe186192cdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.171148:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.171149:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.171151:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787865077.172532:0:15059:0:(ofd_dev.c:1522:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787865077.172623:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14397:x1874712087066112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 156575us (158512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865077.172648:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865077.173023:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14397:1874712087066112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787865077.173039:0:14397:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787865077.173091:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14397:1874712087066240:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787865077.173127:0:14397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865077.173165:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204f219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865077.173188:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066240 00000100:00100000:0.0:1787865077.173200:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066240 00002000:00010000:1.0:1787865077.173777:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.173786:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.173800:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.173811:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.173818:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.173831:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865077.174345:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787865077.174355:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14397:x1874712087066240:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787865077.174410:0:15058:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787865077.176954:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.176979:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.177004:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787865077.180904:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.180916:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.180933:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.180937:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.180944:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.180958:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.180970:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.180985:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.181004:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787865077.181019:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787865077.181025:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.181034:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b600 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.181038:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.181462:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.181919:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.181940:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.181948:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001c6e507/0xa63eebe186192ceb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.181964:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.181966:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.181967:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182819:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182829:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.182848:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865077.182852:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.182860:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.182880:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.182887:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003086e75a/0xa63eebe186192cf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.182902:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182904:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182906:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182910:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865077.182912:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787865077.184378:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787865077.184411:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184426:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1787865077.184430:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865077.184436:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184448:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184457:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184464:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184482:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787865077.184493:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787865077.184498:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184505:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:1.0:1787865077.184508:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184517:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184535:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184542:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d509dc/0xa63eebe186192cf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.184688:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.184691:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865077.184692:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787865077.185890:0:15056:0:(ofd_dev.c:1522:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787865077.185996:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14395:x1874712087065856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 190696us (194510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865077.186007:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787865077.186806:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14395:1874712087065856:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787865077.186827:0:14395:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787865077.187102:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14395:1874712087066368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787865077.187146:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865077.187177:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066368 00000100:00100000:2.0:1787865077.187183:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066368 00000100:00100000:3.0:1787865077.187185:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa204f00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787865077.187222:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787865077.187231:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14395:x1874712087066368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787865077.187268:0:15059:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787865077.192147:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14395:x1874712087066368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4911us (4994us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787865077.192158:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787865077.192910:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14395:1874712087066368:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787865077.192928:0:14395:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1787865077.194164:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14397:x1874712087066240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19807us (21032us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787865077.194177:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787865077.194303:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14397:1874712087066240:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787865077.194315:0:14397:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1787865077.197262:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:1.0:1787865077.693560:0:14369:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787865077.693568:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa105f5d800 from 8 10000000:01000000:1.0:1787865077.693573:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787865077.693619:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.693631:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.693642:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865077.693666:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087066496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787865077.693741:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865077.693803:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865077.693856:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066496 00000100:00100000:0.0:1787865077.693863:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066496 00000100:00100000:0.0:1787865077.693914:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787865077.693922:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087066496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865077.693935:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865077.693947:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492400/0xa63eebe186192d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192d00 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.693969:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492400/0xa63eebe186192d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192d00 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.693978:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492400/0xa63eebe186192d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192d00 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865077.693986:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492400, rc 0) 00000100:00100000:0.0:1787865077.694032:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087066496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865077.694039:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787865077.695041:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087066496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787865077.695083:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192d07 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.695094:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192d07 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865077.695164:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087066624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787865077.695213:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865077.695257:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20351a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787865077.695305:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066624 00000100:00100000:2.0:1787865077.695311:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066624 00000100:00100000:2.0:1787865077.695357:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787865077.695367:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087066624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787865077.695384:0:14367:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787865077.695430:0:14367:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787865077.695434:0:14367:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787865077.695524:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087066624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865077.695533:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787865077.695966:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f5583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087066624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787865077.696027:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787865077.696035:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192d07 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865077.696054:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa21177a600/0xa63eebe186192d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192d07 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865077.883903:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787865078.377965:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787865078.377982:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787865078.907630:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865079.931733:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865080.955766:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787865081.420147:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787865081.420167:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1787865081.847923:0:16137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787865081.980535:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787865082.364720:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067008:0@lo:400:kworker.0 00000100:00100000:0.0:1787865082.364790:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865082.364864:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787865082.364870:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087067136:0@lo:400:kworker.0 00000100:00100000:0.0:1787865082.364898:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865082.364931:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067136 00000100:00100000:0.0:1787865082.364937:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067136 00000100:00100000:0.0:1787865082.364978:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787865082.364987:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865082.365052:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087067136:12345-0@lo:400:kworker.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865082.365060:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787865082.365100:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cc780 x1874712087067136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787865082.365113:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087067136:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087066752:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865082.365277:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087067264:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365297:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865082.365316:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787865082.365330:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087066880:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365354:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865082.365369:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087067392:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365389:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865082.365438:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067008 00000100:00100000:1.0:1787865082.365442:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067008 00000100:00100000:1.0:1787865082.365478:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066880 00000100:00100000:1.0:1787865082.365482:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066880 00000100:00100000:1.0:1787865082.365501:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865082.365509:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365543:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067008:12345-0@lo:400:kworker.0 Request processed in 36us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865082.365548:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787865082.365562:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865082.365567:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087066880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365596:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087066880:12345-0@lo:400:kworker.0 Request processed in 29us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865082.365602:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865082.365618:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087066752 00000100:00100000:1.0:1787865082.365622:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087066752 00000100:00100000:1.0:1787865082.365645:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787865082.365652:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365680:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087066752:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865082.365685:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787865082.365712:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067264 00000100:00100000:1.0:1787865082.365716:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067264 00000100:00100000:1.0:1787865082.365747:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067392 00000100:00100000:1.0:1787865082.365751:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067392 00000100:00100000:1.0:1787865082.365765:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787865082.365771:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365801:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087067264:12345-0@lo:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865082.365806:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787865082.365818:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787865082.365824:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087067392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365850:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087067392:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865082.365856:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787865082.365872:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787865082.365877:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787865082.365879:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787865082.365896:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787865082.365909:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087066880:0@lo:400:kworker.0 00010000:00080000:1.0:1787865082.365919:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1cf480 x1874712087067392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865082.365929:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087067392:0@lo:400:kworker.0 00000100:00100000:1.0:1787865082.365936:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087066752:0@lo:400:kworker.0 00010000:00080000:1.0:1787865082.365944:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa20c1ce1c0 x1874712087067264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787865098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787865082.365951:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087067264:0@lo:400:kworker.0 00000100:00100000:0.0:1787865082.366161:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787865082.366173:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067008:0@lo:400:kworker.0 00000100:00100000:0.0:1787865082.369552:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787865082.369625:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865082.369660:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787865082.369667:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787865082.369690:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865082.369726:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067520 00000100:00100000:0.0:1787865082.369732:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067520 00000100:00100000:0.0:1787865082.369766:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067648 00000100:00100000:0.0:1787865082.369769:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067648 00000100:00100000:0.0:1787865082.369782:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787865082.369796:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787865082.369842:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865082.369894:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865082.369901:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787865082.369916:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787865082.369922:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787865082.369940:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865082.369967:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087067648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865082.369973:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787865082.369989:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787865082.370005:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20cb5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087067520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787865083.004647:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787865083.324193:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787865083.777956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865083.778077:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071346944 00000100:00100000:1.0:1787865083.778090:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071346944 00000100:00100000:1.0:1787865083.778147:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787865083.778157:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1874712071346944:12345-192.168.206.10@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787865083.778195:0:14365:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from a1cbe2c0-8fbd-4374-9043-54b59c00ae32@192.168.206.10@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1787865083.778232:0:14365:0:(genops.c:1385:class_connect()) connect: client a1cbe2c0-8fbd-4374-9043-54b59c00ae32, cookie 0xa63eebe186192d0e 00000100:00080000:2.0:1787865083.778806:0:14365:0:(import.c:65:import_set_state_nolock()) ffff9fa208665000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787865083.778905:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+5:2355:x1874712071346944:12345-192.168.206.10@tcp:250:mount.lustre.0 Request processed in 746us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.778916:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:2.0:1787865083.787728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865083.787864:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347072 00000100:00100000:1.0:1787865083.787877:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347072 00000100:00100000:1.0:1787865083.787985:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787865083.787997:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+5:13736:x1874712071347072:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787865083.788028:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865083.788051:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21177ae00/0xa63eebe186192d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7cac expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865083.788090:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21177ae00/0xa63eebe186192d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cac expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865083.788103:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21177ae00/0xa63eebe186192d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cac expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865083.788114:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177ae00, rc 0) 00000100:00100000:1.0:1787865083.788182:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+6:13736:x1874712071347072:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 187us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865083.788190:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787865083.793041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865083.793132:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347200 00000100:00100000:2.0:1787865083.793144:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347200 00000100:00100000:2.0:1787865083.793220:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787865083.793232:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+6:13736:x1874712071347200:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787865083.793843:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+6:13736:x1874712071347200:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 611us (815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787865083.793855:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787865083.807540:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865083.810853:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347328 00000100:00100000:1.0:1787865083.810876:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347328 00000100:00100000:2.0:1787865083.811300:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787865083.811316:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+6:13736:x1874712071347328:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787865083.811342:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865083.811437:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa203580c00/0xa63eebe186192d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7cb3 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865083.811478:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa203580c00/0xa63eebe186192d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cb3 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865083.811493:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa203580c00/0xa63eebe186192d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cb3 expref: 7 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865083.811504:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580c00, rc 0) 00000100:00100000:2.0:1787865083.811600:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+7:13736:x1874712071347328:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 288us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.811608:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:0.0:1787865083.818065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865083.818186:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347456 00000100:00100000:2.0:1787865083.818199:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347456 00000100:00100000:2.0:1787865083.818273:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787865083.818285:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+7:13736:x1874712071347456:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787865083.818879:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13736:x1874712071347456:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 593us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.818889:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787865083.823624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.823915:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347584 00000100:00100000:3.0:1787865083.823986:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347584 00000100:00100000:3.0:1787865083.824167:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:3.0:1787865083.824195:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13736:x1874712071347584:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787865083.824725:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13736:x1874712071347584:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 531us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.824735:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:0.0:1787865083.831696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.832028:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347712 00000100:00100000:3.0:1787865083.832039:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347712 00000100:00100000:3.0:1787865083.832112:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:3.0:1787865083.832124:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13755:x1874712071347712:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787865083.832959:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13755:x1874712071347712:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 830us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.832970:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:0.0:1787865083.856725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865083.865384:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347840 00000100:00100000:1.0:1787865083.865607:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347840 00000100:00100000:1.0:1787865083.865687:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:1.0:1787865083.865699:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13755:x1874712071347840:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787865083.867579:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13755:x1874712071347840:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 1866us (10854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865083.867596:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:0.0:1787865083.883201:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.883958:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071347968 00000100:00100000:3.0:1787865083.883973:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071347968 00000100:00100000:3.0:1787865083.884060:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:3.0:1787865083.884072:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+8:13736:x1874712071347968:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787865083.884094:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865083.884118:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b350a00/0xa63eebe186192d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7cdd expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.884156:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350a00/0xa63eebe186192d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cdd expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.885977:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b350a00/0xa63eebe186192d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7cdd expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.885991:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350a00, rc 0) 00000100:00100000:3.0:1787865083.886105:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+9:13736:x1874712071347968:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 2035us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.886115:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787865083.889175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865083.894905:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348096 00000100:00100000:1.0:1787865083.894925:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348096 00000100:00100000:2.0:1787865083.897766:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:2.0:1787865083.897786:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+9:13736:x1874712071348096:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787865083.897837:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787865083.897872:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787865083.897878:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787865083.897889:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787865083.897891:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787865083.902152:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+9:13736:x1874712071348096:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 4355us (12973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.902172:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:1.0:1787865083.908286:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.908556:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348224 00000100:00100000:3.0:1787865083.908569:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348224 00000100:00100000:3.0:1787865083.908641:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787865083.908654:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+9:13736:x1874712071348224:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787865083.908676:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865083.908699:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7ce4 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.908738:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.908752:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865083.908764:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351400, rc 0) 00000100:00100000:3.0:1787865083.908842:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13736:x1874712071348224:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 190us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.908850:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787865083.910719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865083.910979:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348352 00000100:00100000:2.0:1787865083.910991:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348352 00000100:00100000:2.0:1787865083.911070:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:2.0:1787865083.911082:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13736:x1874712071348352:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787865083.912136:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13736:x1874712071348352:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 1047us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.912150:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787865083.914518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.914635:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348480 00000100:00100000:3.0:1787865083.914647:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348480 00000100:00100000:3.0:1787865083.914750:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:3.0:1787865083.914763:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13736:x1874712071348480:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787865083.915266:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13736:x1874712071348480:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 505us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.915289:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:1.0:1787865083.924775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865083.929264:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348608 00000100:00100000:2.0:1787865083.929284:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348608 00000100:00100000:2.0:1787865083.929479:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:2.0:1787865083.929493:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13759:x1874712071348608:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787865083.929919:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13759:x1874712071348608:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 428us (5159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865083.929930:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:0.0:1787865083.934744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865083.934860:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348736 00000100:00100000:3.0:1787865083.934874:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348736 00000100:00100000:3.0:1787865083.934948:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:3.0:1787865083.934960:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13759:x1874712071348736:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787865083.935371:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13759:x1874712071348736:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 411us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865083.935379:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:1.0:1787865083.955799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865083.955929:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348864 00000100:00100000:0.0:1787865083.955945:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348864 00000100:00100000:0.0:1787865083.956007:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787865083.956027:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874712071348864:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787865083.956072:0:14374:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 6adbe011-80a1-414e-9ce7-e503cb628098@192.168.206.10@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:0.0:1787865083.956140:0:14374:0:(genops.c:1385:class_connect()) connect: client 6adbe011-80a1-414e-9ce7-e503cb628098, cookie 0xa63eebe186192d31 00000004:00100000:0.0:1787865083.956185:0:14374:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787865083.956212:0:14374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787865084.011295:0:14374:0:(import.c:65:import_set_state_nolock()) ffff9fa2126f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787865084.011460:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+6:2355:x1874712071348864:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 55431us (55674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865084.011474:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787865084.017828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865084.017944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865084.020182:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071348992 00000100:00100000:0.0:1787865084.020199:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071348992 00000100:00100000:0.0:1787865084.020305:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349120 00000100:00100000:0.0:1787865084.020309:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349120 00000100:00100000:0.0:1787865084.020330:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787865084.020341:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+7:0:x1874712071348992:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787865084.020417:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787865084.020550:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+7:0:x1874712071348992:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 209us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865084.020559:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787865084.020581:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787865084.020588:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f5583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349120:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787865084.020600:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787865084.020621:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f5583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349120:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 34us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865084.020628:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00080000:1.0:1787865084.020902:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787865084.026848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865084.026960:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349248 00000100:00100000:0.0:1787865084.026972:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349248 00000100:00100000:0.0:1787865084.027053:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787865084.027065:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349248:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787865084.027192:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349248:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865084.027219:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:3.0:1787865084.028074:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865084.031258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865084.031318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865084.031447:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349376 00000100:00100000:3.0:1787865084.031460:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349376 00000100:00100000:0.0:1787865084.031531:0:15823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349504 00000100:00100000:0.0:1787865084.031541:0:15823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349504 00000100:00100000:0.0:1787865084.031591:0:15823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787865084.031600:0:15823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21337a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1874712071349376:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787865084.031640:0:15823:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6adbe011-80a1-414e-9ce7-e503cb628098@192.168.206.10@tcp t0 exp 0000000000000000 cur 399 last 0 00000100:00100000:3.0:1787865084.031661:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787865084.031672:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071349504:12345-192.168.206.10@tcp:8:mount.lustre.0 00000020:00000080:0.0:1787865084.031684:0:15823:0:(genops.c:1385:class_connect()) connect: client 6adbe011-80a1-414e-9ce7-e503cb628098, cookie 0xa63eebe186192d38 00002000:00100000:0.0:1787865084.031700:0:15823:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6adbe011-80a1-414e-9ce7-e503cb628098/ffff9fa2126f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1787865084.031708:0:15059:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6adbe011-80a1-414e-9ce7-e503cb628098@192.168.206.10@tcp t0 exp 0000000000000000 cur 399 last 0 00002000:00100000:0.0:1787865084.031715:0:15823:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1787865084.031751:0:15059:0:(genops.c:1385:class_connect()) connect: client 6adbe011-80a1-414e-9ce7-e503cb628098, cookie 0xa63eebe186192d3f 00002000:00100000:3.0:1787865084.031766:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6adbe011-80a1-414e-9ce7-e503cb628098/ffff9fa20769a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787865084.031781:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787865084.032175:0:15059:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787865084.032213:0:15059:0:(import.c:65:import_set_state_nolock()) ffff9fa20769e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787865084.032369:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21337a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adbe011-80a1-414e-9ce7-e503cb628098+6:2355:x1874712071349504:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 694us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865084.032379:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00002000:00080000:0.0:1787865084.032569:0:15823:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787865084.032602:0:15823:0:(import.c:65:import_set_state_nolock()) ffff9fa2126f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787865084.032656:0:15823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21337a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adbe011-80a1-414e-9ce7-e503cb628098+6:2355:x1874712071349376:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 1055us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865084.032665:0:15823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787865084.037041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865084.038824:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349632 00000100:00100000:0.0:1787865084.038850:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349632 00000100:00100000:0.0:1787865084.038931:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787865084.038944:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349632:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787865084.047647:0:14375:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8597us 00000004:00200000:1.0:1787865084.075946:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787865084.076187:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:13736:x1874712071349632:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 37240us (39149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865084.076202:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787865084.276466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865084.276868:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349760 00000100:00100000:2.0:1787865084.276877:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349760 00000100:00100000:2.0:1787865084.276939:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787865084.276949:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+6:13780:x1874712071349760:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:2.0:1787865084.276967:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865084.276991:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d0e expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277074:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277087:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277100:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865084.277673:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787865084.277679:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787865084.277784:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277818:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580e00/0xa63eebe186192d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d0e expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277836:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d0e expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865084.277844:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:2.0:1787865084.277847:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787865084.277850:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580a00, rc 0) 00000100:00100000:2.0:1787865084.277916:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+7:13780:x1874712071349760:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 968us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865084.277923:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:2.0:1787865085.051560:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787865086.079338:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865086.270211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.270327:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071349888 00000100:00100000:3.0:1787865086.270337:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071349888 00000100:00100000:3.0:1787865086.270436:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787865086.270447:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:13832:x1874712071349888:12345-192.168.206.10@tcp:41:lfs.0 00000004:00000024:3.0:1787865086.270489:0:14374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787865086.270593:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:13832:x1874712071349888:12345-192.168.206.10@tcp:41:lfs.0 Request processed in 148us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.270601:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:1.0:1787865086.271690:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787865086.275315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.275425:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350016 00000100:00100000:0.0:1787865086.275435:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350016 00000100:00100000:0.0:1787865086.275510:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787865086.275521:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adbe011-80a1-414e-9ce7-e503cb628098+6:13832:x1874712071350016:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:0.0:1787865086.275558:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865086.275650:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adbe011-80a1-414e-9ce7-e503cb628098+6:13832:x1874712071350016:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 130us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.275671:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00080000:1.0:1787865086.276106:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787865086.279940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.280315:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350144 00000100:00100000:0.0:1787865086.280325:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350144 00000100:00100000:0.0:1787865086.280435:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787865086.280446:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adbe011-80a1-414e-9ce7-e503cb628098+6:13832:x1874712071350144:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:0.0:1787865086.280485:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865086.280569:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adbe011-80a1-414e-9ce7-e503cb628098+6:13832:x1874712071350144:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 126us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.280577:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:1.0:1787865086.281036:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787865086.450513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.451101:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350272 00000100:00100000:1.0:1787865086.451115:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350272 00000100:00100000:1.0:1787865086.451184:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:1.0:1787865086.451195:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+10:13866:x1874712071350272:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787865086.451213:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865086.451233:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21177b800/0xa63eebe186192d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d15 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865086.451262:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21177b800/0xa63eebe186192d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d15 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865086.454224:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21177b800/0xa63eebe186192d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d15 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865086.454246:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b800, rc 0) 00000100:00100000:1.0:1787865086.454416:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350272:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 3204us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.454427:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:1.0:1787865086.459618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.459767:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350400 00000100:00100000:3.0:1787865086.459781:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350400 00000100:00100000:3.0:1787865086.459887:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:3.0:1787865086.459900:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350400:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787865086.460571:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350400:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 668us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.460583:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:2.0:1787865086.469515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.469811:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350528 00000100:00100000:1.0:1787865086.469824:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350528 00000100:00100000:1.0:1787865086.469895:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787865086.469907:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350528:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787865086.470200:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350528:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 294us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.470210:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787865086.478295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.479111:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350656 00000100:00100000:3.0:1787865086.479126:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350656 00000100:00100000:3.0:1787865086.479193:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:3.0:1787865086.479206:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13872:x1874712071350656:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787865086.479780:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f658850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13872:x1874712071350656:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 573us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.479802:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:0.0:1787865086.496881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.496928:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350784 00000100:00100000:0.0:1787865086.496939:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350784 00000100:00100000:0.0:1787865086.497083:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787865086.497094:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13872:x1874712071350784:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787865086.497601:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13872:x1874712071350784:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 506us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.497611:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:1.0:1787865086.502443:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.502777:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071350912 00000100:00100000:0.0:1787865086.502790:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071350912 00000100:00100000:0.0:1787865086.502939:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:0.0:1787865086.503124:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13866:x1874712071350912:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787865086.503148:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865086.503171:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211493600/0xa63eebe186192d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d3f expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.503366:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493600/0xa63eebe186192d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d3f expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.503381:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211493600/0xa63eebe186192d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d3f expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.503392:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493600, rc 0) 00000100:00100000:0.0:1787865086.504468:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13866:x1874712071350912:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 1333us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.504481:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:2.0:1787865086.517934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.518034:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351040 00000100:00100000:3.0:1787865086.518047:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351040 00000100:00100000:3.0:1787865086.518117:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:3.0:1787865086.518129:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13866:x1874712071351040:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787865086.518184:0:14366:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787865086.518205:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787865086.518210:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787865086.518214:0:14366:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787865086.518217:0:14366:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787865086.521688:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13866:x1874712071351040:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 3545us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.521706:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:1.0:1787865086.527992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.528181:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351168 00000100:00100000:0.0:1787865086.528193:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351168 00000100:00100000:0.0:1787865086.528261:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:0.0:1787865086.528273:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13866:x1874712071351168:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787865086.528304:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865086.528332:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d46 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.528369:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.528382:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865086.528393:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492e00, rc 0) 00000100:00100000:0.0:1787865086.528887:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13866:x1874712071351168:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 614us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.528916:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:3.0:1787865086.530556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.530669:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351296 00000100:00100000:1.0:1787865086.530679:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351296 00000100:00100000:1.0:1787865086.530744:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:1.0:1787865086.530756:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13866:x1874712071351296:12345-192.168.206.10@tcp:501:mount.lustre.0 00000001:00100000:2.0:1787865086.530978:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6adbe011-80a1-414e-9ce7-e503cb628098 00000100:00100000:1.0:1787865086.531196:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13866:x1874712071351296:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 441us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.531205:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:2.0:1787865086.533712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.534052:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351424 00000100:00100000:0.0:1787865086.534063:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351424 00000100:00100000:0.0:1787865086.534125:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:0.0:1787865086.534135:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13866:x1874712071351424:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787865086.535135:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13866:x1874712071351424:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 992us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.535147:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:3.0:1787865086.537577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.538614:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351552 00000100:00100000:1.0:1787865086.538630:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351552 00000100:00100000:1.0:1787865086.538767:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:1.0:1787865086.538780:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13877:x1874712071351552:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787865086.539153:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13877:x1874712071351552:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 374us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.539163:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:0.0:1787865086.545215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.545756:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351680 00000100:00100000:1.0:1787865086.545770:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351680 00000100:00100000:1.0:1787865086.545858:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:1.0:1787865086.545871:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f65b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13877:x1874712071351680:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787865086.546218:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f65b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13877:x1874712071351680:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 349us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.546228:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:2.0:1787865086.550877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.555865:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351808 00000100:00100000:3.0:1787865086.555886:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351808 00000100:00100000:2.0:1787865086.559016:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787865086.559030:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874712071351808:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787865086.559070:0:14373:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from fae83741-6409-4973-86e3-948e0cb1ec11@192.168.206.10@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:2.0:1787865086.559284:0:14373:0:(genops.c:1385:class_connect()) connect: client fae83741-6409-4973-86e3-948e0cb1ec11, cookie 0xa63eebe186192d69 00000004:00100000:2.0:1787865086.559325:0:14373:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787865086.559745:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9fa22ed6c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787865086.559841:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+6:2355:x1874712071351808:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 809us (8976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865086.559852:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865086.569669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.569724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.569762:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352064 00000100:00100000:0.0:1787865086.569775:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352064 00000100:00100000:0.0:1787865086.569880:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071351936 00000100:00100000:0.0:1787865086.569884:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071351936 00000100:00100000:0.0:1787865086.569903:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787865086.569915:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+7:13866:x1874712071352064:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787865086.569956:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787865086.570055:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+7:13866:x1874712071352064:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.570063:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787865086.570084:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787865086.570090:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:0:x1874712071351936:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787865086.570103:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787865086.570126:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:0:x1874712071351936:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 36us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865086.570133:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00080000:2.0:1787865086.571055:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865086.574228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865086.574345:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352192 00000100:00100000:1.0:1787865086.574357:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352192 00000100:00100000:1.0:1787865086.574513:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787865086.574710:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:13866:x1874712071352192:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787865086.574873:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:13866:x1874712071352192:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 332us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865086.574881:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787865086.579525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865086.579577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.581321:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352320 00000100:00100000:3.0:1787865086.581394:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352320 00000100:00100000:3.0:1787865086.581482:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352448 00000100:00100000:3.0:1787865086.581486:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352448 00000100:00100000:3.0:1787865086.581587:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787865086.581598:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071352320:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787865086.582016:0:15059:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from fae83741-6409-4973-86e3-948e0cb1ec11@192.168.206.10@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1787865086.582057:0:15059:0:(genops.c:1385:class_connect()) connect: client fae83741-6409-4973-86e3-948e0cb1ec11, cookie 0xa63eebe186192d70 00002000:00100000:3.0:1787865086.582072:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fae83741-6409-4973-86e3-948e0cb1ec11/ffff9fa20769e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787865086.582084:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787865086.582455:0:15059:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787865086.582604:0:15059:0:(import.c:65:import_set_state_nolock()) ffff9fa20769d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787865086.582710:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fae83741-6409-4973-86e3-948e0cb1ec11+6:2355:x1874712071352320:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 1110us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.582742:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787865086.582772:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787865086.582779:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874712071352448:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787865086.582884:0:15059:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from fae83741-6409-4973-86e3-948e0cb1ec11@192.168.206.10@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1787865086.582910:0:15059:0:(genops.c:1385:class_connect()) connect: client fae83741-6409-4973-86e3-948e0cb1ec11, cookie 0xa63eebe186192d77 00002000:00100000:3.0:1787865086.582919:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fae83741-6409-4973-86e3-948e0cb1ec11/ffff9fa23be3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787865086.582927:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787865086.583774:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00002000:00080000:3.0:1787865086.583776:0:15059:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787865086.583886:0:15059:0:(import.c:65:import_set_state_nolock()) ffff9fa23be3d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787865086.583940:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fae83741-6409-4973-86e3-948e0cb1ec11+6:2355:x1874712071352448:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 1159us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.584031:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787865086.584040:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352576 00000100:00100000:2.0:1787865086.584050:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352576 00000100:00100000:2.0:1787865086.584118:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:2.0:1787865086.584128:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+6:13866:x1874712071352576:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787865086.584365:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787865086.584543:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+6:13866:x1874712071352576:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 416us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865086.584559:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787865086.719688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865086.719858:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352704 00000100:00100000:3.0:1787865086.719871:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352704 00000100:00100000:3.0:1787865086.720020:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787865086.720032:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+6:13899:x1874712071352704:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:3.0:1787865086.720059:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865086.720091:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d70 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720177:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720196:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720247:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787865086.720603:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787865086.720608:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787865086.720700:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720735:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351600/0xa63eebe186192d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720756:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865086.720766:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:3.0:1787865086.720770:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787865086.720774:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351a00, rc 0) 00000100:00100000:3.0:1787865086.720933:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+7:13899:x1874712071352704:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 902us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865086.720942:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00010000:00010000:3.0:1787865087.099674:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865087.484524:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087067776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787865087.484584:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087067904:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.484590:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865087.484634:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865087.484655:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087068416:0@lo:400:kworker.0 00000100:00100000:0.0:1787865087.484673:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087068288:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.484689:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865087.484720:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865087.484723:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087068032:0@lo:400:kworker.0 00000100:00100000:0.0:1787865087.484758:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087068160:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.484772:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865087.484795:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068416 00000100:00100000:0.0:1787865087.484802:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068416 00000100:00100000:3.0:1787865087.484808:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087068544:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.484840:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865087.484875:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067776 00000100:00100000:3.0:1787865087.484879:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067776 00000100:00100000:2.0:1787865087.484907:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068032 00000100:00100000:2.0:1787865087.484912:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068032 00000100:00100000:3.0:1787865087.484922:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787865087.484932:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087067776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787865087.484951:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787865087.484973:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787865087.484984:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.485003:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874712087067776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865087.485010:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787865087.485686:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087068032:12345-0@lo:400:kworker.0 Request processed in 703us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865087.485749:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787865087.487589:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087067904 00000100:00100000:1.0:1787865087.487601:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087067904 00000100:00100000:1.0:1787865087.487659:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787865087.487669:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087067904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865087.487763:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087067904:12345-0@lo:400:kworker.0 Request processed in 95us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865087.487771:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787865087.488831:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787865087.488839:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787865087.488842:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865087.489955:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068288 00000100:00100000:0.0:1787865087.489966:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068288 00000100:00100000:0.0:1787865087.490008:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068544 00000100:00100000:0.0:1787865087.490012:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068544 00000100:00080000:0.0:1787865087.490036:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865087.490076:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087067904:0@lo:400:kworker.0 00000100:00100000:0.0:1787865087.490114:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787865087.490122:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087068416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.490206:0:14374:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865087.490206:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874712087068416:12345-0@lo:400:kworker.0 Request processed in 83us (5516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865087.490219:0:14374:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787865087.490219:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787865087.490241:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787865087.490248:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787865087.490250:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.490263:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087068544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865087.490287:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874712087068288:12345-0@lo:400:kworker.0 Request processed in 39us (5567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865087.490306:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787865087.490312:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874712087068544:12345-0@lo:400:kworker.0 Request processed in 54us (5469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865087.490321:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787865087.490337:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874712087068288:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.492057:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865087.492101:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087068672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787865087.492149:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865087.492198:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068160 00000100:00100000:3.0:1787865087.492205:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068160 00000100:00100000:3.0:1787865087.492246:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787865087.492254:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087068160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.492301:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087068160:12345-0@lo:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865087.492314:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787865087.492472:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087068032:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.492496:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1874712087068544:0@lo:400:kworker.0 00000100:00100000:0.0:1787865087.493153:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087068672 00000100:00100000:0.0:1787865087.493159:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087068672 00000100:00100000:0.0:1787865087.493205:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787865087.493214:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087068672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787865087.493234:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787865087.493283:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203ede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087068672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865087.493290:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787865087.493830:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087068160:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.493849:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087068672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787865087.493876:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1874712087068416:0@lo:400:kworker.0 00000100:00100000:3.0:1787865087.493889:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1874712087067776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787865088.123862:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787865088.613980:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6adbe011-80a1-414e-9ce7-e503cb628098 00000001:00100000:0.0:1787865088.614076:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fae83741-6409-4973-86e3-948e0cb1ec11 00000001:00100000:2.0:1787865089.055582:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6adbe011-80a1-414e-9ce7-e503cb628098 00000001:00100000:2.0:1787865089.055610:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fae83741-6409-4973-86e3-948e0cb1ec11 00010000:00010000:1.0:1787865089.148649:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787865089.185895:0:16346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787865090.171619:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865091.196207:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787865091.657918:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fae83741-6409-4973-86e3-948e0cb1ec11 00000100:00100000:0.0:1787865091.746587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865091.746650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865091.746658:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352832 00000100:00100000:2.0:1787865091.746680:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352832 00000100:00100000:0.0:1787865091.746707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865091.746740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865091.746758:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:2.0:1787865091.746770:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:2359:x1874712071352832:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865091.746782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865091.746823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865091.746889:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353088 00000100:00100000:3.0:1787865091.746895:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353088 00000100:00100000:2.0:1787865091.746997:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:2359:x1874712071352832:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 227us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865091.747006:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:3.0:1787865091.747151:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353600 00000100:00100000:3.0:1787865091.747155:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353600 00000100:00100000:0.0:1787865091.750141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865091.752607:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353344 00000100:00100000:0.0:1787865091.752628:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353344 00000100:00100000:1.0:1787865091.752878:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353216 00000100:00100000:1.0:1787865091.752884:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353216 00000100:00100000:1.0:1787865091.752933:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353472 00000100:00100000:1.0:1787865091.752936:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353472 00000100:00100000:1.0:1787865091.752965:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787865091.752991:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2359:x1874712071353088:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865091.753117:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2359:x1874712071353088:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 129us (6468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865091.753126:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787865091.753149:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787865091.753157:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2359:x1874712071353600:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865091.753208:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2359:x1874712071353600:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 52us (6467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865091.753215:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787865091.753228:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787865091.753234:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2359:x1874712071353216:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865091.753258:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2359:x1874712071353216:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (6438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865091.753264:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787865091.753279:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787865091.753284:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2359:x1874712071353472:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865091.753307:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2359:x1874712071353472:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865091.753312:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787865091.754693:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071352960 00000100:00100000:0.0:1787865091.754717:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071352960 00000100:00100000:0.0:1787865091.754777:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787865091.754789:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:2359:x1874712071353344:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865091.754890:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:2359:x1874712071353344:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 103us (8195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865091.754900:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787865091.754918:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:0.0:1787865091.754925:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:2359:x1874712071352960:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865091.754949:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+6:2359:x1874712071352960:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (8177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865091.754955:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00080000:0.0:1787865091.755039:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787865091.755045:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787865091.755049:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787865092.221865:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787865092.514119:0:16496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd06d8bd80 20000000:00000080:0.0:1787865092.514137:0:16496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa106ebd400 uarg=0000000000000000 20000000:01000000:0.0:1787865092.514174:0:16496:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787865092.514180:0:16496:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787865092.514184:0:16496:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787865092.518643:0:16497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787865092.524783:0:16496:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787865092.530764:0:16496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787865092.530794:0:16496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530814:0:16496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192a7c expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530822:0:16496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530827:0:16496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192b39 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530848:0:16496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530855:0:16496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530862:0:16496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530901:0:16496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.530917:0:16496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 12 pid: 14365 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.530931:0:16496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087068800:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865092.531040:0:16496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.531049:0:16496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.531057:0:16496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087068928:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865092.531085:0:16496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.531092:0:16496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 18 pid: 14366 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.531110:0:16496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069056:0@lo:104: 00000100:00100000:0.0:1787865092.531145:0:16496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787865092.531244:0:16496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.531253:0:16496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.531261:0:16496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c0c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069184:0@lo:104: 00000100:00100000:0.0:1787865092.531283:0:16496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787865092.531961:0:16496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.531981:0:16496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 18 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.531990:0:16496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069312:0@lo:104: 00000100:00100000:0.0:1787865092.532020:0:16496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865092.533679:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069056 00000100:00100000:3.0:1787865092.533692:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069056 00000100:00100000:3.0:1787865092.533740:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069184 00000100:00100000:3.0:1787865092.533743:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069184 00000100:00100000:3.0:1787865092.533760:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787865092.533770:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+4:16496:x1874712087069056:12345-0@lo:104: 00010000:00010000:3.0:1787865092.533787:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.533879:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787865092.533886:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+4:16496:x1874712087069056:12345-0@lo:104: Request processed in 118us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865092.533894:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787865092.533922:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787865092.533929:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:16496:x1874712087069184:12345-0@lo:104: 00010000:00010000:3.0:1787865092.533937:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.533986:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787865092.533991:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:16496:x1874712087069184:12345-0@lo:104: Request processed in 63us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865092.533997:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787865092.534055:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787865092.534062:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534070:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336a600 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865092.534075:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534083:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865092.534101:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865092.534107:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787865092.534152:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534158:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865092.534180:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534187:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336a600/0xa63eebe186192b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192b40 expref: -99 pid: 15774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534200:0:14361:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787865092.534203:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534209:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580800 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:2.0:1787865092.534212:0:14361:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534218:0:14361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787865092.534225:0:14361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787865092.534229:0:14361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787865092.534252:0:14361:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534257:0:14361:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787865092.534264:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534270:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa203580800/0xa63eebe186192ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192ad0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.534279:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865092.534280:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865092.534281:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787865092.534288:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865092.534300:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087069440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865092.534355:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865092.534385:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787865092.534391:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087069568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865092.534438:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865092.534680:0:16496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787865092.534704:0:16496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069056:0@lo:104: 00000100:00100000:0.0:1787865092.534712:0:16496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069184:0@lo:104: 00000100:00100000:0.0:1787865092.534743:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069440 00000100:00100000:0.0:1787865092.534747:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069440 00010000:00010000:0.0:1787865092.534772:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 19 pid: 14366 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.534800:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069568 00000100:00100000:0.0:1787865092.534804:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069568 00010000:00010000:0.0:1787865092.534826:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 20 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.534841:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787865092.534847:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+20:3315:x1874712087069440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787865092.534857:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865092.534861:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 20 pid: 14366 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.534871:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 20 pid: 14366 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.534885:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa203581200/0xa63eebe186192b40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192b39 expref: 20 pid: 14366 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.534898:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865092.534928:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087069440:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865092.534935:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787865092.534949:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787865092.534955:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+18:3315:x1874712087069568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787865092.534974:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865092.534979:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.534987:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.534996:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa203581800/0xa63eebe186192ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192ac9 expref: 18 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.535016:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865092.535040:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:3315:x1874712087069568:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865092.535046:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787865092.535118:0:14355:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787865092.535132:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069312 00000100:00100000:3.0:1787865092.535136:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069312 00000100:00100000:3.0:1787865092.535155:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787865092.535161:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:16496:x1874712087069312:12345-0@lo:104: 00010000:00010000:3.0:1787865092.535170:0:14355:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535223:0:14355:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787865092.535228:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d7f3274-06f9-466a-8cc1-a9159491893b+3:16496:x1874712087069312:12345-0@lo:104: Request processed in 68us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865092.535235:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787865092.535525:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865092.535530:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535538:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21336b200 already unused, calling callback (ffffffffc1e06c20) 10000000:00010000:3.0:1787865092.535541:0:14360:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535563:0:14360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787865092.535570:0:14360:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787865092.535576:0:14360:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787865092.535604:0:14360:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535611:0:14360:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787865092.535627:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535634:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9fa21336b200/0xa63eebe186192a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa63eebe186192a83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535648:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865092.535650:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865092.535652:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787865092.535721:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d7f3274-06f9-466a-8cc1-a9159491893b:3317:1874712087069696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787865092.535755:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865092.535847:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069696 00000100:00100000:3.0:1787865092.535852:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069696 00010000:00010000:3.0:1787865092.535868:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 17 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865092.535889:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787865092.535896:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:3317:x1874712087069696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787865092.535911:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865092.535917:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 17 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535925:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 17 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.535938:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865092.535977:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:3317:x1874712087069696:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865092.535983:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787865092.536036:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d7f3274-06f9-466a-8cc1-a9159491893b:3317:1874712087069696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865092.536126:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087069568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787865092.536136:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087069440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787865092.536279:0:16496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087068800:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787865092.536288:0:16496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c0c70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087068928:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865092.536308:0:16496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa211492000/0xa63eebe186192a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa63eebe186192a7c expref: 16 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.536319:0:16496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16496:1874712087069312:0@lo:104: 00010000:00010000:0.0:1787865092.536357:0:16496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865092.538884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865092.538978:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353728 00000100:00100000:3.0:1787865092.538988:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353728 00010000:00010000:3.0:1787865092.539027:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865092.539076:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787865092.539086:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:2358:x1874712071353728:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787865092.539101:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865092.539106:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.539120:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.539143:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa211492e00/0xa63eebe186192d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d46 expref: 13 pid: 14365 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865092.539179:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865092.539252:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:2358:x1874712071353728:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 158us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865092.539260:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787865092.540815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865092.540886:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353856 00000100:00100000:2.0:1787865092.540894:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353856 00010000:00010000:2.0:1787865092.540924:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865092.540959:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787865092.540978:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:2359:x1874712071353856:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787865092.541004:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865092.541010:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541022:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541039:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa23b351400/0xa63eebe186192d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7ce4 expref: 12 pid: 14367 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541054:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541062:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541078:0:14358:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541085:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541091:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541098:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541104:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865092.541108:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541126:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541148:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865092.541159:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787865092.541256:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:2359:x1874712071353856:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865092.541264:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:0.0:1787865092.541353:0:16496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.541362:0:16496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865092.541369:0:16496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa211493000/0xa63eebe186192d8c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865092.603571:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787865092.603575:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa21015b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087069952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787865092.603586:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087069824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787865092.604805:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087070336:0@lo:400:kworker.0 00000100:00100000:2.0:1787865092.606782:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865092.606940:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069824 00000100:00100000:2.0:1787865092.606948:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069824 00000100:00100000:1.0:1787865092.607009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865092.607011:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787865092.607021:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087069824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787865092.607055:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087070464:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.607097:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865092.607119:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787865092.607125:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087070080:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.607150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865092.607167:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087070592:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.607188:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865092.607226:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070464 00000100:00100000:1.0:1787865092.607230:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070464 00000100:00100000:1.0:1787865092.607260:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070592 00000100:00100000:1.0:1787865092.607263:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070592 00000100:00100000:1.0:1787865092.607285:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787865092.607292:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087070464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.607337:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087070464:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865092.607344:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787865092.607360:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00002000:00000024:2.0:1787865092.607361:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787865092.607366:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087070592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.607390:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087070592:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865092.607392:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087069824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 375us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865092.607415:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787865092.607417:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787865092.607430:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087069952 00000100:00100000:1.0:1787865092.607431:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070080 00000100:00100000:2.0:1787865092.607433:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087069952 00000100:00100000:1.0:1787865092.607433:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070080 00000100:00100000:2.0:1787865092.607451:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787865092.607518:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865092.607543:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787865092.607550:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087070208:0@lo:400:kworker.0 00000100:00100000:3.0:1787865092.607572:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865092.607776:0:15823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070208 00000100:00100000:0.0:1787865092.607781:0:15823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070208 00000100:00100000:0.0:1787865092.607807:0:15823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787865092.607814:0:15823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087070208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865092.607864:0:15823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087070208:12345-0@lo:400:kworker.0 Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865092.607870:0:15823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787865092.607905:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087070208:0@lo:400:kworker.0 00000100:00080000:3.0:1787865092.611730:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787865092.613723:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787865092.613737:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874712087070080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.613823:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1874712087070080:12345-0@lo:400:kworker.0 Request processed in 90us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865092.613830:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787865092.613862:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070336 00000100:00100000:1.0:1787865092.613870:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070336 00000100:00100000:1.0:1787865092.613891:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787865092.613898:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087070336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.613940:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f55bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874712087070336:12345-0@lo:400:kworker.0 Request processed in 42us (6421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865092.613957:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787865092.614023:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203eded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874712087070336:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.614064:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087070080:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.614076:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087070592:0@lo:400:kworker.0 00000100:00100000:1.0:1787865092.614085:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa203edf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087070464:0@lo:400:kworker.0 00000100:00080000:3.0:1787865092.616503:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787865092.616511:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787865092.616571:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2101583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087069952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787865092.616578:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa1075d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087069824:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787865092.616668:0:15060:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787865092.616752:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2101583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087069952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9295us (9742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865092.616768:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787865092.616772:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa21015b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087069952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787865093.243495:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787865093.570824:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787865093.793355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865093.793470:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071353984 00000100:00100000:3.0:1787865093.793480:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071353984 00000100:00100000:3.0:1787865093.793541:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:3.0:1787865093.793551:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+11:13750:x1874712071353984:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865093.793568:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865093.793588:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b350e00/0xa63eebe186192d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d77 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.793615:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b350e00/0xa63eebe186192d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d77 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.793627:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b350e00/0xa63eebe186192d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d77 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.793643:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b350e00, rc 0) 00000100:00100000:3.0:1787865093.793701:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071353984:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 150us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865093.793709:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:1.0:1787865093.796889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865093.797615:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354112 00000100:00100000:2.0:1787865093.797625:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354112 00000100:00100000:2.0:1787865093.797707:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:2.0:1787865093.797717:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071354112:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787865093.798014:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071354112:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 298us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865093.798023:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:0.0:1787865093.807917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865093.807988:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354240 00000100:00100000:1.0:1787865093.807998:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354240 00000100:00100000:1.0:1787865093.808048:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:1.0:1787865093.808058:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071354240:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787865093.808263:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071354240:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 205us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865093.808272:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787865093.825131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865093.825198:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354368 00000100:00100000:1.0:1787865093.825206:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354368 00000100:00100000:1.0:1787865093.825260:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:1.0:1787865093.825269:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+12:13750:x1874712071354368:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787865093.825284:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865093.825303:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa21177be00/0xa63eebe186192d9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d7e expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865093.825329:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa21177be00/0xa63eebe186192d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d7e expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865093.825352:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa21177be00/0xa63eebe186192d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d7e expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865093.825361:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177be00, rc 0) 00000100:00100000:1.0:1787865093.825431:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13750:x1874712071354368:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 163us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865093.825438:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 10000000:01000000:0.0:1787865093.826488:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787865093.826493:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa23b534000 from 10 10000000:01000000:0.0:1787865093.826498:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787865093.826532:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.826542:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.826551:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.826572:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.826623:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.826669:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787865093.826820:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070720 00000100:00100000:3.0:1787865093.826826:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070720 00000100:00100000:3.0:1787865093.826865:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787865093.826873:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+16:14369:x1874712087070720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787865093.826883:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787865093.826893:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa23b351600/0xa63eebe186192da8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192da1 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.826911:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa23b351600/0xa63eebe186192da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192da1 expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.826921:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa23b351600/0xa63eebe186192da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192da1 expref: 17 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865093.826928:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa23b351600, rc 0) 00000100:00100000:3.0:1787865093.826970:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087070720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865093.826976:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787865093.827176:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865093.827192:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192da8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.827201:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192da8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.827261:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.827283:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.827308:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.827322:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070848 00000100:00100000:0.0:1787865093.827326:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070848 00000100:00100000:0.0:1787865093.827354:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787865093.827360:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087070848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.827595:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087070848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.827602:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787865093.827627:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.827652:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.827683:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.827694:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bc3d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.827703:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087070976 00000100:00100000:0.0:1787865093.827706:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087070976 00000100:00100000:0.0:1787865093.827720:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787865093.827725:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087070976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.827859:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087070976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.827865:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787865093.827897:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087070976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787865093.828519:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787865093.828574:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787865093.828592:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787865093.828600:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192da8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828610:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211492c00/0xa63eebe186192da1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192da8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787865093.828619:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787865093.828621:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa208006800 from 10 10000000:01000000:0.0:1787865093.828623:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787865093.828644:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828651:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828658:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.828672:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.828704:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.828719:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20c192e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.828731:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071104 00000100:00100000:0.0:1787865093.828735:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071104 00000100:00100000:0.0:1787865093.828755:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787865093.828761:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+17:14369:x1874712087071104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865093.828770:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865093.828780:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492200/0xa63eebe186192db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192daf expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828810:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492200/0xa63eebe186192db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192daf expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828819:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492200/0xa63eebe186192db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192daf expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828828:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492200, rc 0) 00000100:00100000:0.0:1787865093.828856:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.828862:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787865093.828895:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865093.828906:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192db6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.828914:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192db6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.828952:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.828988:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.829000:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa20c192e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.829009:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071232 00000100:00100000:0.0:1787865093.829012:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071232 00000100:00100000:0.0:1787865093.829027:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787865093.829032:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.829213:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f797c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.829228:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787865093.829256:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.829279:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.829310:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.829322:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02000 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.829333:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071360 00000100:00100000:0.0:1787865093.829336:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071360 00000100:00100000:0.0:1787865093.829352:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787865093.829356:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.829489:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.829495:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787865093.829528:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787865093.831891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865093.833034:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354496 00000100:00100000:0.0:1787865093.833045:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354496 00000100:00100000:0.0:1787865093.833096:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:0.0:1787865093.833105:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13750:x1874712071354496:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000040:00080000:1.0:1787865093.834529:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:0.0:1787865093.835915:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13750:x1874712071354496:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 2803us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.835928:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000020:01000000:0.0:1787865093.835983:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787865093.836010:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787865093.836018:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192db6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836041:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211492800/0xa63eebe186192daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192db6 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787865093.836051:0:14369:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787865093.836053:0:14369:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa105f5d800 from 10 10000000:01000000:0.0:1787865093.836056:0:14369:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787865093.836087:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836093:0:14369:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836101:0:14369:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.836121:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.836168:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.836203:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.836220:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071488 00000100:00100000:0.0:1787865093.836225:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071488 00000100:00100000:0.0:1787865093.836256:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787865093.836264:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+18:14369:x1874712087071488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865093.836275:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865093.836286:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa211492e00/0xa63eebe186192dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa63eebe186192dbd expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836323:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa211492e00/0xa63eebe186192dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa63eebe186192dbd expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836346:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa211492e00/0xa63eebe186192dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa63eebe186192dbd expref: 19 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836354:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211492e00, rc 0) 00000100:00100000:0.0:1787865093.836385:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087071488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.836391:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787865093.836448:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787865093.836461:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192dc4 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.836469:0:14369:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa63eebe186192dc4 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865093.836511:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.836534:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.836546:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.836558:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071616 00000100:00100000:0.0:1787865093.836561:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071616 00000100:00100000:0.0:1787865093.836579:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787865093.836584:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087071616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.836756:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087071616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.836762:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787865093.836792:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.836826:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.836860:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865093.836873:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d02780 going to sleep for 11 seconds 00000100:00100000:0.0:1787865093.836883:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087071744 00000100:00100000:0.0:1787865093.836887:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087071744 00000100:00100000:0.0:1787865093.836905:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787865093.836911:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087071744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.837052:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d7f3274-06f9-466a-8cc1-a9159491893b+19:14369:x1874712087071744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.837059:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787865093.837095:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d7f3274-06f9-466a-8cc1-a9159491893b:14369:1874712087071744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787865093.837714:0:16566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787865093.837761:0:14369:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787865093.837778:0:14369:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787865093.837785:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192dc4 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865093.837794:0:14369:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9fa211492a00/0xa63eebe186192dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa63eebe186192dc4 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865093.852309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865093.852464:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354624 00000100:00100000:0.0:1787865093.852475:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354624 00000100:00100000:0.0:1787865093.852528:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:0.0:1787865093.852538:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13750:x1874712071354624:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787865093.852749:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:13750:x1874712071354624:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 212us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865093.852766:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00010000:00010000:2.0:1787865094.267537:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865095.293782:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787865095.659089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.659247:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071354752 00000100:00100000:0.0:1787865095.659256:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071354752 00000100:00100000:0.0:1787865095.659335:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787865095.659345:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+6:14409:x1874712071354752:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787865095.659363:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865095.659384:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d85 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659484:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659498:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659525:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659540:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659547:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.659553:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.660015:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186192de0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787865095.661211:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787865095.661273:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186192de0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.661347:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186192de0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865095.661654:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787865095.661659:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787865095.664351:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186192de0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664375:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664382:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664389:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664412:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211493c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.664417:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664425:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664442:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787865095.664445:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.664450:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664473:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493c00/0xa63eebe186192dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664487:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664492:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664498:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664518:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa211492000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.664522:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664529:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664537:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa20378bc00) 00010000:00010000:0.0:1787865095.664541:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.664543:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664550:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492000/0xa63eebe186192dd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664598:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211492600/0xa63eebe186192dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d85 expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664625:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa211493000/0xa63eebe186192de0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d85 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.664632:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:0.0:1787865095.664634:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787865095.664636:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa211493000, rc 0) 00000100:00100000:0.0:1787865095.664704:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:14409:x1874712071354752:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 5360us (5625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865095.664713:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787865095.669250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.669341:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355008 00000100:00100000:0.0:1787865095.669350:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355008 00000100:00100000:0.0:1787865095.669438:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787865095.669449:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+7:14409:x1874712071355008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787865095.669468:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865095.669520:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165c00/0xa63eebe186192de7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d8c expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669595:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669609:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669620:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669679:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669694:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.669700:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675154:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b200/0xa63eebe186192dfc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675174:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b200/0xa63eebe186192dfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675186:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b200/0xa63eebe186192dfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865095.675201:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787865095.675708:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675718:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675725:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675803:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865095.675808:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675817:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675832:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa20378b700) 00010000:00010000:1.0:1787865095.675835:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865095.675841:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675848:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164600/0xa63eebe186192dee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675864:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675871:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675877:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675882:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865095.675885:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675892:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675910:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa20378bd00) 00010000:00010000:1.0:1787865095.675913:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865095.675916:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.675922:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164000/0xa63eebe186192df5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.677648:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165c00/0xa63eebe186192de7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d8c expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.677675:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b200/0xa63eebe186192dfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d8c expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.677684:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa20e551300) 00010000:00010000:1.0:1787865095.677687:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865095.677690:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b200, rc 0) 00000100:00100000:1.0:1787865095.677868:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+9:14409:x1874712071355008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 8419us (8625us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787865095.677877:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787865095.692807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.692895:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355136 00000100:00100000:0.0:1787865095.692903:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355136 00000100:00100000:0.0:1787865095.692969:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787865095.692978:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+9:14409:x1874712071355136:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787865095.693087:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+9:14409:x1874712071355136:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865095.693095:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787865095.727016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865095.727098:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355264 00000100:00100000:1.0:1787865095.727110:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355264 00000100:00100000:1.0:1787865095.727183:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787865095.727194:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+9:14415:x1874712071355264:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787865095.727214:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865095.727233:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ba00/0xa63eebe186192e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d93 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727303:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727316:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727327:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727341:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727348:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.727355:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731154:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731170:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731177:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731183:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177aa00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.731187:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731194:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731222:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787865095.731226:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.731230:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731237:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192e11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731252:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731257:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731263:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731268:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.731271:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731277:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731285:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa20e551100) 00010000:00010000:0.0:1787865095.731287:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.731290:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731296:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192e18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731349:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ba00/0xa63eebe186192e0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d93 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731359:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787865095.731362:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.731365:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ba00/0xa63eebe186192e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d93 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.731375:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177ba00, rc 0) 00000100:00100000:0.0:1787865095.731551:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+9:14415:x1874712071355264:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 4357us (4547us total) trans 0 rc 301/301 00000100:00100000:0.0:1787865095.731560:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787865095.736376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865095.737961:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355392 00000100:00100000:1.0:1787865095.737974:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355392 00000100:00100000:1.0:1787865095.738031:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787865095.738042:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6adbe011-80a1-414e-9ce7-e503cb628098+9:14415:x1874712071355392:12345-192.168.206.10@tcp:700:lfs.0 00000100:00100000:1.0:1787865095.738128:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6adbe011-80a1-414e-9ce7-e503cb628098+9:14415:x1874712071355392:12345-192.168.206.10@tcp:700:lfs.0 Request processed in 87us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865095.738136:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787865095.757970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.760745:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355648 00000100:00100000:0.0:1787865095.760765:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355648 00000100:00100000:0.0:1787865095.760864:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:0.0:1787865095.760877:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+9:14415:x1874712071355648:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:0.0:1787865095.760964:0:16267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865095.761000:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192d4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d0e expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.761028:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787865095.761033:0:16267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787865095.761471:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.761489:0:16267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 5 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.761506:0:16267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.761547:0:16267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 5 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.761562:0:16267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 5 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865095.761579:0:16267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16267:1874712087071872:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787865095.761700:0:16267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d04c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787865095.768620:0:16267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16267:1874712087071872:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865095.768658:0:16267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865095.775654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.775788:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355776 00000100:00100000:0.0:1787865095.775801:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355776 00010000:00010000:0.0:1787865095.775877:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 6 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865095.775925:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787865095.775937:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae83741-6409-4973-86e3-948e0cb1ec11+6:2359:x1874712071355776:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787865095.775970:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865095.775978:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 6 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776017:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 6 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776043:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351a00/0xa63eebe186192d85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d70 expref: 6 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776064:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:0.0:1787865095.776071:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776081:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776090:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.776132:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787865095.776200:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae83741-6409-4973-86e3-948e0cb1ec11+5:2359:x1874712071355776:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 265us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865095.776208:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:3.0:1787865095.776462:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787865095.777043:0:16267:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.777055:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.777097:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.777110:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.777119:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865095.779699:0:16267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787865095.779722:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.779734:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.779741:0:16267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.779747:0:16267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865095.779753:0:16267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.779763:0:16267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.779781:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51b00) 00010000:00010000:1.0:1787865095.781619:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865095.781636:0:16267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.781676:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164200/0xa63eebe186192e1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787865095.781715:0:16267:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040c08470 reply state 000000006a64c56f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865095.781726:0:16267:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787865095.782583:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+10:14415:x1874712071355648:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 21699us (24615us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787865095.782885:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00010000:00010000:1.0:1787865095.793007:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793027:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793035:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793041:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865095.793046:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793054:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793073:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa20e551800) 00010000:00010000:1.0:1787865095.793077:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865095.793082:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.793110:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192e26 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865095.865729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865095.865865:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071355904 00000100:00100000:2.0:1787865095.865877:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071355904 00000100:00100000:2.0:1787865095.865957:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787865095.865969:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+9:14423:x1874712071355904:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:2.0:1787865095.865998:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865095.866030:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7d9a expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866112:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192e34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866127:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866161:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865095.866234:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787865095.866239:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787865095.866295:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192e34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866325:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d9a expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866346:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581800/0xa63eebe186192e34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7d9a expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.866357:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:2.0:1787865095.866360:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787865095.866365:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581800, rc 0) 00000100:00100000:2.0:1787865095.866501:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+10:14423:x1874712071355904:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 533us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865095.866510:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787865095.890672:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865095.890797:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071356032 00000100:00100000:1.0:1787865095.890886:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071356032 00000100:00100000:1.0:1787865095.890974:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787865095.890985:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fae83741-6409-4973-86e3-948e0cb1ec11+5:14424:x1874712071356032:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787865095.891010:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865095.891036:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7da1 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891363:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177bc00/0xa63eebe186192e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891381:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177bc00/0xa63eebe186192e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891500:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177bc00/0xa63eebe186192e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865095.891578:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787865095.891583:0:14374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787865095.891611:0:14374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177bc00/0xa63eebe186192e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891641:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7da1 expref: 7 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891663:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177bc00/0xa63eebe186192e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7da1 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.891691:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:1.0:1787865095.891695:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787865095.891699:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177bc00, rc 0) 00000100:00100000:1.0:1787865095.891893:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fae83741-6409-4973-86e3-948e0cb1ec11+6:14424:x1874712071356032:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 908us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865095.891902:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787865095.896509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865095.896595:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071356160 00000100:00100000:2.0:1787865095.896607:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071356160 00000100:00100000:2.0:1787865095.896725:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787865095.896747:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+6:14424:x1874712071356160:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787865095.896773:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865095.896799:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192e49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7da8 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.896977:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.896996:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.897010:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.897026:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.897033:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.897041:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901589:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901682:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901695:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865095.901763:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787865095.901768:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787865095.901798:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901842:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901849:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901855:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901861:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865095.901865:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901871:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901883:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:2.0:1787865095.901887:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787865095.901892:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901899:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580200/0xa63eebe186192e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901913:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901919:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901923:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901934:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865095.901937:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901943:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901965:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa206f51100) 00010000:00010000:2.0:1787865095.901967:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787865095.901970:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.901976:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581400/0xa63eebe186192e57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.903662:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581200/0xa63eebe186192e49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7da8 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.903689:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7da8 expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.903697:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:2.0:1787865095.903700:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787865095.903702:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203580800, rc 0) 00000100:00100000:2.0:1787865095.903787:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+7:14424:x1874712071356160:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 7051us (7290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865095.903796:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787865095.908322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865095.908450:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071356416 00000100:00100000:1.0:1787865095.908460:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071356416 00000100:00100000:1.0:1787865095.908516:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787865095.908527:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fae83741-6409-4973-86e3-948e0cb1ec11+7:14424:x1874712071356416:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787865095.908546:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865095.908565:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7daf expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865095.908877:0:16267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787865095.909038:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192e65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7daf expref: 9 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.909052:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:1.0:1787865095.909055:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787865095.909060:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7daf expref: 9 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865095.909072:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177a200, rc 0) 00000100:00100000:1.0:1787865095.912309:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fae83741-6409-4973-86e3-948e0cb1ec11+8:14424:x1874712071356416:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3772us (3984us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787865095.912336:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787865095.919176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.919266:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071356672 00000100:00100000:0.0:1787865095.919275:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071356672 00000100:00100000:0.0:1787865095.919332:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:0.0:1787865095.919341:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+8:14424:x1874712071356672:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:0.0:1787865095.919393:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865095.919474:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580800/0xa63eebe186192e5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7da8 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.919492:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51800) 00010000:00010000:0.0:1787865095.919503:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787865095.919537:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.919550:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.919560:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787865095.919783:0:14372:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000947523a8 reply state 00000000720ae219 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865095.919793:0:14372:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787865095.919805:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787865095.919894:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fae83741-6409-4973-86e3-948e0cb1ec11+9:14424:x1874712071356672:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 552us (725us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787865095.919901:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00010000:00010000:0.0:1787865095.922347:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865095.922355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787865095.922360:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.922366:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.922372:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164e00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.922381:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.922389:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.922426:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa20378bc00) 00010000:00010000:0.0:1787865095.922430:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787865095.922434:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.922441:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e73 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865095.922687:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071356928 00000100:00100000:1.0:1787865095.922695:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071356928 00000100:00100000:1.0:1787865095.922748:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787865095.922758:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+8:14424:x1874712071356928:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787865095.923132:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+9:14424:x1874712071356928:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 374us (780us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787865095.923149:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787865095.930067:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865095.930165:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071357184 00000100:00100000:0.0:1787865095.930174:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071357184 00000100:00100000:0.0:1787865095.930272:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787865095.930282:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fae83741-6409-4973-86e3-948e0cb1ec11+9:14424:x1874712071357184:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787865095.930304:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865095.930324:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7db6 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930389:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930431:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930443:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930457:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930477:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930484:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865095.930617:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787865095.930705:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930713:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930720:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930725:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.930729:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930737:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930749:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787865095.930752:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.930757:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930763:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192e81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930788:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930794:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930800:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930805:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865095.930808:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930814:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930822:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa20378bc00) 00010000:00010000:0.0:1787865095.930824:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865095.930827:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930832:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192e88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930868:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7db6 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930878:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787865095.930881:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787865095.930891:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7db6 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865095.930901:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242164e00, rc 0) 00000100:00100000:0.0:1787865095.930964:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fae83741-6409-4973-86e3-948e0cb1ec11+10:14424:x1874712071357184:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 683us (904us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787865095.930971:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787865095.939351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865095.940900:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071357312 00000100:00100000:2.0:1787865095.940912:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071357312 00000100:00100000:2.0:1787865095.941047:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787865095.941058:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+10:14424:x1874712071357312:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787865095.941080:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865095.941100:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192e96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dbd expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941179:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941192:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941202:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787865095.941247:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787865095.941252:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787865095.941274:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941299:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186192e96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941316:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865095.941325:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51100) 00010000:00010000:2.0:1787865095.941338:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787865095.941342:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581a00, rc 0) 00000100:00100000:2.0:1787865095.941564:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f558780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+11:14424:x1874712071357312:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 502us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865095.941571:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787865095.948695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865095.948764:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071357440 00000100:00100000:1.0:1787865095.948774:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071357440 00000100:00100000:1.0:1787865095.948823:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787865095.948831:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+11:14424:x1874712071357440:12345-192.168.206.10@tcp:37:lfs.0 00000100:00100000:2.0:1787865095.963440:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fae83741-6409-4973-86e3-948e0cb1ec11+11:14424:x1874712071357440:12345-192.168.206.10@tcp:37:lfs.0 Request processed in 14556us (14699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865095.963454:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787865095.974716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865095.976014:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071357696 00000100:00100000:2.0:1787865095.976389:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071357696 00000100:00100000:2.0:1787865095.976717:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787865095.976731:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b850c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fae83741-6409-4973-86e3-948e0cb1ec11+11:14424:x1874712071357696:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787865095.977353:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b850c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fae83741-6409-4973-86e3-948e0cb1ec11+12:14424:x1874712071357696:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 622us (2647us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787865095.977363:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787865096.042726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.042824:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071357824 00000100:00100000:0.0:1787865096.042835:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071357824 00000100:00100000:0.0:1787865096.042888:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787865096.042896:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+10:14430:x1874712071357824:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787865096.042915:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865096.042933:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dc4 expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043000:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043013:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043024:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043037:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043043:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043050:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043171:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165a00/0xa63eebe186192eb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043180:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165a00/0xa63eebe186192eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043188:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165a00/0xa63eebe186192eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865096.043217:0:16267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787865096.043221:0:16267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787865096.043259:0:16267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165a00/0xa63eebe186192eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043270:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043277:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043284:0:16267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043290:0:16267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865096.043294:0:16267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043301:0:16267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043312:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:0.0:1787865096.043320:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865096.043326:0:16267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043332:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043344:0:16267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043350:0:16267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043356:0:16267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043361:0:16267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865096.043364:0:16267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043369:0:16267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043376:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa20378bc00) 00010000:00010000:0.0:1787865096.043378:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865096.043380:0:16267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043386:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192eb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043505:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dc4 expref: 12 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043528:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165a00/0xa63eebe186192eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dc4 expref: 11 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.043536:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51100) 00010000:00010000:0.0:1787865096.043538:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787865096.043540:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242165a00, rc 0) 00000100:00100000:0.0:1787865096.043604:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+11:14430:x1874712071357824:12345-192.168.206.10@tcp:101:bash.0 Request processed in 708us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865096.043611:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787865096.053904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.054056:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071358080 00000100:00100000:0.0:1787865096.054064:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071358080 00000100:00100000:0.0:1787865096.054127:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787865096.054137:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+11:14430:x1874712071358080:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787865096.054156:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865096.054175:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192ec0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dcb expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.054295:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.054309:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.054318:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.054349:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.054374:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 11 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865096.054388:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072000:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787865096.054497:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d04540 going to sleep for 11 seconds 00000100:00100000:2.0:1787865096.058961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.059036:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071358208 00000100:00100000:3.0:1787865096.059045:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071358208 00010000:00010000:3.0:1787865096.059133:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 12 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865096.059174:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865096.059183:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae83741-6409-4973-86e3-948e0cb1ec11+12:2359:x1874712071358208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787865096.059195:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865096.059201:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 12 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.059213:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 12 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.059232:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51100) 00010000:00010000:3.0:1787865096.059237:0:14359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.059246:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.059253:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.059268:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865096.059308:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae83741-6409-4973-86e3-948e0cb1ec11+12:2359:x1874712071358208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.059329:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:1.0:1787865096.060828:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581a00/0xa63eebe186192e9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dbd expref: 11 pid: 14373 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.060849:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1ce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072000:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787865096.060870:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.060880:0:14372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.060885:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.060918:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.060929:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.060937:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062756:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062773:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062786:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865096.062798:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787865096.062824:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062832:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062838:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062844:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164c00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865096.062849:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062870:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062883:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51100) 00010000:00010000:1.0:1787865096.062886:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865096.062891:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062897:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164c00/0xa63eebe186192ec7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787865096.062910:0:14372:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a5714bf reply state 00000000e405ff27 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.062918:0:14372:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787865096.062963:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164e00/0xa63eebe186192ec0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062978:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.062986:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.062988:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787865096.062990:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177a000, rc 0) 00000100:00100000:1.0:1787865096.063066:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210158b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+14:14430:x1874712071358080:12345-192.168.206.10@tcp:101:bash.0 Request processed in 8929us (9171us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787865096.063074:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00010000:00010000:1.0:1787865096.071910:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.071941:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.071974:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.071981:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865096.071986:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.071994:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.072009:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fa20e551800) 00010000:00010000:1.0:1787865096.072012:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787865096.072017:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.072024:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ece lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.083620:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.083711:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071358336 00000100:00100000:0.0:1787865096.083720:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071358336 00000100:00100000:0.0:1787865096.083778:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:0.0:1787865096.083788:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+13:14430:x1874712071358336:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787865096.083809:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865096.083829:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192ee3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dd2 expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.083892:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.083905:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.083915:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865096.083968:0:16267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787865096.083973:0:16267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787865096.083990:0:16267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.084000:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.084039:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192ee3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 15 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.084055:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 14 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.084063:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:0.0:1787865096.084066:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787865096.084070:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242164a00, rc 0) 00000100:00100000:0.0:1787865096.084129:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+14:14430:x1874712071358336:12345-192.168.206.10@tcp:101:bash.0 Request processed in 343us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865096.084136:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:3.0:1787865096.089558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.089645:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071358592 00000100:00100000:1.0:1787865096.089655:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071358592 00000100:00100000:1.0:1787865096.089706:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787865096.089716:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6adbe011-80a1-414e-9ce7-e503cb628098+14:14430:x1874712071358592:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787865096.090059:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6adbe011-80a1-414e-9ce7-e503cb628098+15:14430:x1874712071358592:12345-192.168.206.10@tcp:35:bash.0 Request processed in 343us (508us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787865096.090067:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787865096.196914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.197016:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071358848 00000100:00100000:1.0:1787865096.197025:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071358848 00000100:00100000:1.0:1787865096.197134:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:1.0:1787865096.197145:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+15:14440:x1874712071358848:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787865096.197166:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865096.197186:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dd9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865096.197297:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787865096.197448:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ef1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd9 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.197463:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa206f51400) 00010000:00010000:1.0:1787865096.197466:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787865096.197471:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192ef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd9 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.197486:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b400, rc 0) 00000100:00100000:1.0:1787865096.197549:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+16:14440:x1874712071358848:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 406us (645us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787865096.197557:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:1.0:1787865096.200896:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.201059:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071359104 00000100:00100000:0.0:1787865096.201068:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071359104 00000100:00100000:0.0:1787865096.201118:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787865096.201128:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+16:14440:x1874712071359104:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787865096.201672:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+17:14440:x1874712071359104:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 543us (782us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787865096.201681:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787865096.248972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.249282:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071359360 00000100:00100000:1.0:1787865096.249291:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071359360 00000100:00100000:1.0:1787865096.249347:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:1.0:1787865096.249367:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+17:14443:x1874712071359360:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787865096.249387:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865096.249447:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192eff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7de0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.249538:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.249551:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.249563:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865096.249573:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787865096.249695:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192eff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de0 expref: 20 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.249712:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de0 expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.249721:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.249724:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787865096.249727:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177a200, rc 0) 00000100:00100000:1.0:1787865096.249788:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+19:14443:x1874712071359360:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 433us (824us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787865096.249808:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:1.0:1787865096.254158:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.254239:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071359488 00000100:00100000:0.0:1787865096.254248:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071359488 00000100:00100000:0.0:1787865096.254310:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787865096.254320:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+19:14443:x1874712071359488:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787865096.254382:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254454:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254469:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254495:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254502:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254508:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254514:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865096.254518:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254525:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254535:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:0.0:1787865096.254538:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787865096.254542:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.254548:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865096.254621:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+19:14443:x1874712071359488:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 301us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865096.254634:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787865096.255647:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.255728:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071359616 00000100:00100000:1.0:1787865096.255734:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071359616 00000100:00100000:1.0:1787865096.255791:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787865096.255810:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+19:2358:x1874712071359616:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787865096.255829:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865096.255847:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de0 expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.255862:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.255865:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865096.255905:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+18:2358:x1874712071359616:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.255912:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787865096.256764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.256987:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071359872 00000100:00100000:1.0:1787865096.256994:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071359872 00000100:00100000:1.0:1787865096.257041:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787865096.257050:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6adbe011-80a1-414e-9ce7-e503cb628098+18:14443:x1874712071359872:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787865096.257325:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6adbe011-80a1-414e-9ce7-e503cb628098+19:14443:x1874712071359872:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 275us (563us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787865096.257332:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:2.0:1787865096.315592:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865096.516823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.516955:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071360128 00000100:00100000:1.0:1787865096.516963:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071360128 00000100:00100000:1.0:1787865096.517025:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:1.0:1787865096.517036:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+19:14474:x1874712071360128:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787865096.517058:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865096.517079:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7de7 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.517176:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192f22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.517207:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192f22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.517220:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192f22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865096.517233:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787865096.517389:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de7 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.517702:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192f22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de7 expref: 21 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.517711:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.517714:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787865096.517717:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b400, rc 0) 00000100:00100000:1.0:1787865096.517827:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+21:14474:x1874712071360128:12345-192.168.206.10@tcp:101:cat.0 Request processed in 793us (1014us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787865096.517835:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787865096.523133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865096.524115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.524318:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071360512 00000100:00100000:0.0:1787865096.524328:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071360512 00000100:00100000:0.0:1787865096.524533:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787865096.524544:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+21:14474:x1874712071360512:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787865096.524963:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+22:14474:x1874712071360512:12345-192.168.206.10@tcp:35:cat.0 Request processed in 420us (1836us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787865096.524972:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787865096.525080:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071360256 00000100:00100000:3.0:1787865096.525086:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071360256 00000100:00100000:3.0:1787865096.525128:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787865096.525136:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6adbe011-80a1-414e-9ce7-e503cb628098+22:2359:x1874712071360256:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787865096.525146:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787865096.525169:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b400/0xa63eebe186192f22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7de7 expref: 22 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865096.525186:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:3.0:1787865096.525190:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787865096.525210:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6adbe011-80a1-414e-9ce7-e503cb628098+21:2359:x1874712071360256:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 76us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.525327:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787865096.606872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.607134:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071360768 00000100:00100000:0.0:1787865096.607146:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071360768 00000100:00100000:0.0:1787865096.607216:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787865096.607226:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+21:14480:x1874712071360768:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787865096.607253:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865096.607277:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dee expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607385:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607424:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607432:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 22 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607440:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607485:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 22 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607499:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 22 pid: 16267 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865096.607511:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072128:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865096.607611:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.607621:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865096.607629:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072256:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787865096.607651:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa207d04b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787865096.615190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.615225:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072128:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787865096.615235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.615244:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14372:1874712087072256:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865096.615269:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.616047:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071360896 00000100:00100000:1.0:1787865096.616055:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071360896 00010000:00010000:1.0:1787865096.616093:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 23 pid: 16267 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.616171:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361024 00000100:00100000:1.0:1787865096.616175:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361024 00010000:00010000:1.0:1787865096.616191:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 24 pid: 14372 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.616233:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787865096.616243:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:2358:x1874712071360896:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787865096.616258:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865096.616264:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 24 pid: 16267 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616274:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 24 pid: 16267 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616295:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186192eea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dd2 expref: 24 pid: 16267 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616309:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.616313:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616321:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616327:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865096.616423:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+23:2358:x1874712071360896:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 156us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.616440:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787865096.616855:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787865096.616866:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+22:2358:x1874712071361024:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787865096.616886:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865096.616893:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616905:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616920:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192ed5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dcb expref: 22 pid: 14372 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616931:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.616935:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616953:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616961:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.616985:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787865096.617017:0:14372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.617027:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865096.617055:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787865096.617232:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dee expref: 23 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.617248:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165400/0xa63eebe186192f37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dee expref: 22 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.617255:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:0.0:1787865096.617258:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787865096.617261:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242165400, rc 0) 00000100:00100000:1.0:1787865096.618187:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+22:2358:x1874712071361024:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1318us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.618197:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787865096.618205:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+22:14480:x1874712071360768:12345-192.168.206.10@tcp:101:dd.0 Request processed in 10977us (11343us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787865096.618214:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787865096.621923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865096.622214:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361280 00000100:00100000:0.0:1787865096.622224:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361280 00000100:00100000:0.0:1787865096.622279:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787865096.622288:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+21:14480:x1874712071361280:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:0.0:1787865096.622567:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.622584:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.622595:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787865096.622640:0:16267:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787865096.622695:0:16267:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fdd3aa4 reply state 000000001bb47e73 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865096.622704:0:16267:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787865096.623154:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+24:14480:x1874712071361280:12345-192.168.206.10@tcp:36:dd.0 Request processed in 864us (1238us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787865096.623163:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000020:00080000:0.0:1787865096.623168:0:16267:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787865096.631229:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.631309:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361408 00000100:00100000:1.0:1787865096.631319:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361408 00010000:00010000:0.0:1787865096.631376:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.631389:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865096.631428:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00010000:00010000:0.0:1787865096.631433:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.631441:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165e00 already unused, calling callback (ffffffffc22294f0) 00000100:00100000:1.0:1787865096.631446:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:14480:x1874712071361408:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787865096.631448:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.631460:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865096.631483:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:0.0:1787865096.631486:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865096.631491:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.631494:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865096.631498:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165e00/0xa63eebe186192f45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.631519:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7df5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.631578:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7df5 expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.631591:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7df5 expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.631607:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.631610:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787865096.631612:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177a200, rc 0) 00000100:00100000:1.0:1787865096.631662:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:14480:x1874712071361408:12345-192.168.206.10@tcp:101:dd.0 Request processed in 223us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.631669:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000040:00080000:0.0:1787865096.636027:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787865096.652185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865096.654141:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361664 00000100:00100000:2.0:1787865096.654155:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361664 00000100:00100000:2.0:1787865096.654234:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787865096.654245:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6adbe011-80a1-414e-9ce7-e503cb628098+24:14480:x1874712071361664:12345-192.168.206.10@tcp:103:dd.0 00010000:00010000:2.0:1787865096.654261:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865096.654298:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a200/0xa63eebe186192f4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7df5 expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865096.654318:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:2.0:1787865096.654323:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787865096.654420:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6adbe011-80a1-414e-9ce7-e503cb628098+23:14480:x1874712071361664:12345-192.168.206.10@tcp:103:dd.0 Request processed in 152us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865096.654430:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787865096.656519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.656610:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361792 00000100:00100000:1.0:1787865096.656618:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361792 00000100:00100000:1.0:1787865096.656667:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787865096.656676:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+23:14480:x1874712071361792:12345-192.168.206.10@tcp:58:dd.0 00010000:00010000:1.0:1787865096.656768:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.656787:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.656917:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865096.657995:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787865096.658167:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787865096.658250:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787865096.658377:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+23:14480:x1874712071361792:12345-192.168.206.10@tcp:58:dd.0 Request processed in 1698us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.658389:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787865096.660547:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.660672:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071361920 00000100:00100000:1.0:1787865096.660682:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071361920 00000100:00100000:1.0:1787865096.660806:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787865096.660817:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+23:14480:x1874712071361920:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787865096.660837:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865096.660858:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7dfc expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.660913:0:14373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.660925:0:14373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.660954:0:14373:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.660968:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.660979:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865096.660999:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787865096.661004:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 24 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865096.661011:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b600, rc 0) 00000100:00100000:1.0:1787865096.661072:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:14480:x1874712071361920:12345-192.168.206.10@tcp:101:dd.0 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.661080:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787865096.868358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.868433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.868460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.868534:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.868558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.868764:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362176 00000100:00100000:1.0:1787865096.868774:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362176 00000100:00100000:1.0:1787865096.868831:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787865096.868842:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+24:2357:x1874712071362176:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787865096.868857:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362432 00000100:00100000:0.0:1787865096.868863:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362432 00000100:00100000:1.0:1787865096.868921:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+24:2357:x1874712071362176:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.868929:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787865096.868982:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362048 00000100:00100000:1.0:1787865096.868986:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362048 00000100:00100000:1.0:1787865096.869025:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:1.0:1787865096.869033:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:2357:x1874712071362048:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787865096.869060:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1cbe2c0-8fbd-4374-9043-54b59c00ae32+13:2357:x1874712071362048:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865096.869067:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00080000:1.0:1787865096.869100:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787865096.869145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865096.869204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865096.872258:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362688 00000100:00100000:3.0:1787865096.872270:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362688 00000100:00100000:3.0:1787865096.872336:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362304 00000100:00100000:3.0:1787865096.872339:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362304 00000100:00100000:3.0:1787865096.872354:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362816 00000100:00100000:3.0:1787865096.872357:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362816 00000100:00100000:3.0:1787865096.872379:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865096.872390:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2357:x1874712071362432:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865096.872492:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2357:x1874712071362432:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 91us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.872501:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865096.872907:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787865096.872917:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2357:x1874712071362688:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865096.872965:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2357:x1874712071362688:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 50us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.872971:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787865096.872985:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787865096.873097:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2357:x1874712071362304:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865096.873128:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2357:x1874712071362304:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 137us (4569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.873134:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787865096.873147:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787865096.873153:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2357:x1874712071362816:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865096.873175:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fae83741-6409-4973-86e3-948e0cb1ec11+5:2357:x1874712071362816:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (3971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.873203:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00080000:3.0:1787865096.873231:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787865096.873235:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787865096.873267:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362560 00000100:00100000:3.0:1787865096.875408:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362560 00000100:00100000:3.0:1787865096.875499:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787865096.875508:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa210159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+11:2357:x1874712071362560:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787865096.875693:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa210159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fae83741-6409-4973-86e3-948e0cb1ec11+11:2357:x1874712071362560:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 184us (6546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865096.875701:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00010000:00010000:2.0:1787865097.339652:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787865097.662077:0:14404:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787865097.662086:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787865097.662124:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787865097.662130:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787865097.662249:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14404:1874712087072384:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787865097.662360:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b53b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787865097.667157:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa20c1cd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14404:1874712087072384:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787865097.667990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.668264:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071362944 00000100:00100000:0.0:1787865097.668283:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071362944 00000100:00100000:0.0:1787865097.668349:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787865097.668360:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071362944:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787865097.668465:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071362944:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 107us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.668473:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00080000:3.0:1787865097.668529:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787865097.681221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.681310:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071363072 00000100:00100000:1.0:1787865097.681319:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071363072 00000100:00100000:1.0:1787865097.681376:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787865097.681386:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071363072:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787865097.681444:0:14374:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787865097.681544:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071363072:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 159us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.681552:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787865097.685862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865097.685957:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071363200 00000100:00100000:3.0:1787865097.685967:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071363200 00000100:00100000:3.0:1787865097.686026:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:3.0:1787865097.686037:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071363200:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787865097.686105:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686122:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686133:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686166:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686174:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686196:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686230:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686239:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686247:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787865097.686285:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787865097.686290:0:14373:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787865097.686304:0:14373:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686315:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686322:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686329:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686335:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787865097.686339:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686346:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686366:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa20e551300) 00010000:00010000:3.0:1787865097.686369:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787865097.686373:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686380:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350000/0xa63eebe186192f61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686426:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686433:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686439:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686445:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787865097.686448:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686454:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686462:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fa20c2d9600) 00010000:00010000:3.0:1787865097.686464:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787865097.686468:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686473:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b351000/0xa63eebe186192f68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686652:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686659:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686665:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686669:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:3.0:1787865097.686672:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686679:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686687:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:3.0:1787865097.686689:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787865097.686693:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.686699:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa23b350200/0xa63eebe186192f6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865097.686821:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa1075d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071363200:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 785us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865097.686831:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787865097.693108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.693229:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071363456 00000100:00100000:1.0:1787865097.693238:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071363456 00000100:00100000:1.0:1787865097.693304:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787865097.693315:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+24:14482:x1874712071363456:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.693337:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865097.693359:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192f76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e03 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695234:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695257:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695271:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787865097.695289:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787865097.695501:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695510:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695517:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695523:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177aa00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865097.695527:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695534:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695546:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865097.695549:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787865097.695554:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.695560:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192f7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.696435:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192f76 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e03 expref: 26 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.696451:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa20e551300) 00010000:00010000:1.0:1787865097.696454:0:14374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787865097.696459:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192f76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e03 expref: 26 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.696498:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177ac00, rc 0) 00000100:00100000:1.0:1787865097.696576:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+25:14482:x1874712071363456:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 3262us (3476us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787865097.696587:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787865097.700612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865097.700672:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071363584 00000100:00100000:3.0:1787865097.700682:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071363584 00000100:00100000:3.0:1787865097.700751:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787865097.700774:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+25:14482:x1874712071363584:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787865097.700842:0:14372:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787865097.700957:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+25:14482:x1874712071363584:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 184us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865097.700965:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787865097.717186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.717269:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071363840 00000100:00100000:0.0:1787865097.717279:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071363840 00000100:00100000:0.0:1787865097.717434:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787865097.717651:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+25:14482:x1874712071363840:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787865097.717671:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865097.717692:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f8b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e0a expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787865097.718348:0:16267:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787865097.718355:0:16267:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787865097.719094:0:16267:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787865097.720111:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192f92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.720267:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.720278:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.720348:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192f8b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e0a expref: 28 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.720366:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192f92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e0a expref: 27 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.720373:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20378bc00) 00010000:00010000:0.0:1787865097.720376:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787865097.720379:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242164400, rc 0) 00000100:00100000:0.0:1787865097.720787:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+27:14482:x1874712071363840:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 3140us (3609us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787865097.720807:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787865097.724006:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787865097.725065:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087072768:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.725132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.725174:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787865097.725180:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087072896:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.725206:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.725245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087073024:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.725273:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.725294:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787865097.725299:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c3161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087072640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787865097.725323:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.725379:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087072640 00000100:00100000:1.0:1787865097.725386:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087072640 00000100:00100000:1.0:1787865097.725879:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787865097.725891:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087072640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787865097.725923:0:15061:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787865097.725984:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087072640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.725991:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787865097.726044:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c3161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087072640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787865097.726071:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087072896 00000100:00100000:1.0:1787865097.726083:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087072896 00000100:00100000:1.0:1787865097.726113:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087073024 00000100:00100000:1.0:1787865097.726116:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087073024 00000100:00100000:1.0:1787865097.726136:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787865097.726143:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087072896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.726179:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874712087072896:12345-0@lo:400:kworker.0 Request processed in 37us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.726186:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787865097.726198:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787865097.726204:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087073024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.726232:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087073024:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.726239:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787865097.726265:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087073024:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.726288:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1874712087072896:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.726333:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087072768 00000100:00100000:1.0:1787865097.726337:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087072768 00000100:00100000:1.0:1787865097.726361:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787865097.726368:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22eac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087072768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.726435:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22eac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d7f3274-06f9-466a-8cc1-a9159491893b+19:3315:x1874712087072768:12345-0@lo:400:kworker.0 Request processed in 55us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.726442:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787865097.726477:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d7f3274-06f9-466a-8cc1-a9159491893b:3315:1874712087072768:0@lo:400:kworker.0 00000100:00080000:1.0:1787865097.726512:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787865097.726516:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787865097.726975:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087072512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787865097.727015:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.728629:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087072512 00000100:00100000:1.0:1787865097.728699:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087072512 00000100:00100000:1.0:1787865097.728760:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787865097.728770:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087072512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787865097.728804:0:15061:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787865097.728875:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874712087072512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.728882:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787865097.730197:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787865097.730213:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087073152:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.730263:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865097.730388:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1874712087072512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787865097.730464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.730483:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087073280:0@lo:400:kworker.0 00000100:00100000:0.0:1787865097.730522:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865097.730548:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787865097.730553:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087073408:0@lo:400:kworker.0 00000100:00100000:0.0:1787865097.734390:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787865097.734488:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087073152 00000100:00100000:0.0:1787865097.734497:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087073152 00000100:00100000:0.0:1787865097.734547:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364096 00000100:00100000:0.0:1787865097.734551:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364096 00000100:00100000:0.0:1787865097.734571:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087073280 00000100:00100000:0.0:1787865097.734575:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087073280 00000100:00100000:0.0:1787865097.734606:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087073408 00000100:00100000:0.0:1787865097.734610:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087073408 00000100:00100000:0.0:1787865097.734629:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787865097.734638:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087073152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787865097.734649:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787865097.734661:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087073280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787865097.734716:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874712087073152:12345-0@lo:400:kworker.0 Request processed in 79us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.734723:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787865097.734740:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787865097.734747:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087073408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.734814:0:14373:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787865097.734824:0:14373:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787865097.734981:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874712087073280:12345-0@lo:400:kworker.0 Request processed in 322us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865097.734998:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787865097.735017:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787865097.735204:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+27:14482:x1874712071364096:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787865097.735252:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865097.735277:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192f92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e0a expref: 27 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735313:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20378bc00) 00010000:00010000:2.0:1787865097.735323:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787865097.735345:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735359:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735368:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735383:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735390:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735420:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735490:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735497:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735504:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735523:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580a00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865097.735529:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735543:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735552:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa206f51100) 00010000:00010000:2.0:1787865097.735555:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787865097.735559:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735565:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580a00/0xa63eebe186192fa0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735575:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735581:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735587:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735592:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581600 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865097.735595:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735601:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735609:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe0a3a783 (ffff9fa206f51000) 00010000:00010000:2.0:1787865097.735611:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787865097.735614:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.735632:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fa7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe0a3a783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865097.736198:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874712087073408:12345-0@lo:400:kworker.0 Request processed in 1449us (5616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.736207:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787865097.736239:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787865097.736865:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+26:14482:x1874712071364096:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1660us (6396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787865097.736993:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787865097.737587:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874712087073152:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.737681:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1874712087073408:0@lo:400:kworker.0 00000100:00100000:1.0:1787865097.737694:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1874712087073280:0@lo:400:kworker.0 00000100:00100000:3.0:1787865097.743543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.743892:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364224 00000100:00100000:1.0:1787865097.743902:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364224 00000100:00100000:1.0:1787865097.743976:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787865097.743986:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+26:14482:x1874712071364224:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.744004:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865097.744028:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192fae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e11 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744062:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192fb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744075:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744099:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744529:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192fae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e11 expref: 28 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744549:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177aa00/0xa63eebe186192fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e11 expref: 27 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.744559:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:1.0:1787865097.744562:0:14373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787865097.744565:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177aa00, rc 0) 00000100:00100000:1.0:1787865097.744667:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+27:14482:x1874712071364224:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 682us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.744675:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787865097.749832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.753618:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364480 00000100:00100000:1.0:1787865097.753631:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364480 00000100:00100000:1.0:1787865097.753688:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787865097.753697:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+27:14482:x1874712071364480:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.753789:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.753805:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.753817:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787865097.755563:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787865097.755582:0:14374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413695185238ns, next at 414695181318ns, rc = 0 00000004:00010000:1.0:1787865097.755691:0:14374:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065223761 reply state 000000004f9d1e05 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865097.755702:0:14374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787865097.756598:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adbe011-80a1-414e-9ce7-e503cb628098+29:14482:x1874712071364480:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 2896us (6770us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787865097.756607:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00010000:00010000:1.0:1787865097.760902:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.760919:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.760927:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.760946:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865097.760951:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.760959:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.760975:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:1.0:1787865097.760978:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787865097.760983:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.761007:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b000/0xa63eebe186192fbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865097.762588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865097.762668:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364608 00000100:00100000:2.0:1787865097.762677:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364608 00000100:00100000:2.0:1787865097.762731:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787865097.762741:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+28:14482:x1874712071364608:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787865097.762778:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787865097.762796:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e18 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.762848:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 29 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.762860:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 29 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.762877:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:2.0:1787865097.762880:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787865097.762883:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa203581600, rc 0) 00000100:00100000:2.0:1787865097.762943:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adbe011-80a1-414e-9ce7-e503cb628098+29:14482:x1874712071364608:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 195us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865097.762951:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787865097.766631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.766975:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364736 00000100:00100000:1.0:1787865097.766985:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364736 00000100:00100000:1.0:1787865097.767045:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787865097.767055:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+5:2358:x1874712071364736:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787865097.768189:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+6:2358:x1874712071364736:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 1131us (1561us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787865097.768199:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865097.770871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.770979:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071364992 00000100:00100000:0.0:1787865097.770988:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071364992 00000100:00100000:0.0:1787865097.771057:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787865097.771067:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+29:14482:x1874712071364992:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787865097.771443:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+30:14482:x1874712071364992:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 375us (577us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787865097.771451:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787865097.774128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.774519:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071365248 00000100:00100000:1.0:1787865097.774528:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071365248 00000100:00100000:1.0:1787865097.774620:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787865097.774630:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+30:14482:x1874712071365248:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787865097.774736:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203eded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+30:14482:x1874712071365248:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 99us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.774744:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787865097.776769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.776909:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071365376 00000100:00100000:0.0:1787865097.776917:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071365376 00000100:00100000:0.0:1787865097.776970:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787865097.776979:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+30:14482:x1874712071365376:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787865097.776994:0:16267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787865097.777011:0:16267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e1f expref: -99 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777067:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777079:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777105:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787865097.777140:0:16267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787865097.777238:0:16267:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777263:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e1f expref: 32 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777359:0:16267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e1f expref: 31 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.777368:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:0.0:1787865097.777371:0:16267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787865097.777374:0:16267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa242164400, rc 0) 00000100:00100000:0.0:1787865097.777552:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+31:14482:x1874712071365376:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 573us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.777560:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787865097.780593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.780709:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071365504 00000100:00100000:1.0:1787865097.780719:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071365504 00000100:00100000:1.0:1787865097.780788:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787865097.780798:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adbe011-80a1-414e-9ce7-e503cb628098+6:2359:x1874712071365504:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.780815:0:15059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865097.780835:0:15059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e26 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787865097.780880:0:15059:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a80a, blocks: 0x1 00010000:00010000:1.0:1787865097.780898:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1787865097.780903:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865097.780913:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 7 pid: 15059 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.780944:0:15059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 7 pid: 15059 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.780958:0:15059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177ac00, rc 0) 00000100:00100000:1.0:1787865097.781096:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:2359:x1874712071365504:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 298us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.781104:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787865097.783659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865097.783998:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071365760 00000100:00100000:2.0:1787865097.784006:0:16610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071365760 00000100:00100000:2.0:1787865097.784111:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:2.0:1787865097.784122:0:16610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adbe011-80a1-414e-9ce7-e503cb628098+31:14482:x1874712071365760:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787865097.784230:0:16610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adbe011-80a1-414e-9ce7-e503cb628098+31:14482:x1874712071365760:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 110us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865097.784237:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787865097.786308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.786473:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071365888 00000100:00100000:1.0:1787865097.786482:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071365888 00000100:00100000:1.0:1787865097.786604:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787865097.786614:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+31:14482:x1874712071365888:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787865097.824539:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa203edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adbe011-80a1-414e-9ce7-e503cb628098+31:14482:x1874712071365888:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 37916us (38228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.824552:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000001:00080000:3.0:1787865097.824985:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787865097.825008:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1787865097.825019:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787865097.825059:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787865097.825245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087073536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787865097.825309:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787865097.825517:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087073536 00000100:00100000:1.0:1787865097.825524:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087073536 00000100:00100000:1.0:1787865097.825572:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787865097.825594:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874712087073536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787865097.825745:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787865097.825749:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787865097.825751:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787865097.825753:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787865098 -> 1787865098 00002000:00010000:1.0:1787865097.825756:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787865097.825807:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1874712087073536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (497us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787865097.825815:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1787865097.825905:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa22f3f4780/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787865097.825912:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1874712087073536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787865097.832037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.833084:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366016 00000100:00100000:1.0:1787865097.833095:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366016 00000100:00100000:0.0:1787865097.833321:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787865097.833333:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:2356:x1874712071366016:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787865097.833482:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adbe011-80a1-414e-9ce7-e503cb628098+7:2356:x1874712071366016:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 151us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.833490:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787865097.841710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.841918:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366272 00000100:00100000:0.0:1787865097.841927:0:16267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366272 00000100:00100000:0.0:1787865097.842108:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787865097.842120:0:16267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+14:14482:x1874712071366272:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787865097.842171:0:16267:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865097.842198:0:16267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164400/0xa63eebe186192fd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e1f expref: 14 pid: 16267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.842217:0:16267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:0.0:1787865097.842236:0:16267:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787865097.842265:0:16267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.842291:0:16267:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.842300:0:16267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787865097.842527:0:16267:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000398772bc reply state 00000000d0237a5d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865097.842535:0:16267:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787865097.842968:0:16267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adbe011-80a1-414e-9ce7-e503cb628098+15:14482:x1874712071366272:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 849us (1266us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787865097.842976:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:0.0:1787865097.847433:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847454:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847462:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847468:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165200 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:0.0:1787865097.847473:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847481:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847516:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:0.0:1787865097.847519:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787865097.847524:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.847531:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242165200/0xa63eebe186192fdf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16267 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865097.847966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.848460:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366400 00000100:00100000:1.0:1787865097.848469:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366400 00000100:00100000:1.0:1787865097.848517:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787865097.848527:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adbe011-80a1-414e-9ce7-e503cb628098+7:14482:x1874712071366400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.848545:0:15056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787865097.848563:0:15056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x252b8a25c00f7e2d expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.848591:0:15056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.848600:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865097.848604:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865097.848608:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 8 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.848658:0:15056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.848672:0:15056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865097.848686:0:15056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15056:1874712087073664:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787865097.848779:0:15056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210ccac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787865097.858791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.858862:0:15056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15056:1874712087073664:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787865097.858894:0:15056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 8 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.858915:0:15056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa21177b400, rc 0) 00000100:00100000:0.0:1787865097.858988:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adbe011-80a1-414e-9ce7-e503cb628098+8:14482:x1874712071366400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 10461us (11026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.859007:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787865097.859138:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366528 00000100:00100000:3.0:1787865097.859145:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366528 00010000:00010000:3.0:1787865097.859176:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865097.860126:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787865097.860141:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6adbe011-80a1-414e-9ce7-e503cb628098+8:2359:x1874712071366528:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787865097.860156:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787865097.860302:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.860319:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.860343:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040e9b076/0xa63eebe186192fd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e26 expref: 8 pid: 15059 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.860358:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865097.860363:0:14359:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865097.860370:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 7 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.860393:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 7 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.860473:0:14359:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 7 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865097.860487:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c317840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14359:1874712087073792:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787865097.860555:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454780 going to sleep for 11 seconds 00000100:00100000:1.0:1787865097.866220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865097.866783:0:15823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366656 00000100:00100000:3.0:1787865097.866793:0:15823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366656 00000100:00100000:3.0:1787865097.866850:0:15823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787865097.866860:0:15823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adbe011-80a1-414e-9ce7-e503cb628098+8:2358:x1874712071366656:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787865097.867128:0:15823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787865097.867132:0:15823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787865097 00002000:00010000:3.0:1787865097.867135:0:15823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787865096 00002000:00010000:3.0:1787865097.867137:0:15823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787865098 -> 1787865097 00002000:00010000:3.0:1787865097.867139:0:15823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787865097.867196:0:15823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adbe011-80a1-414e-9ce7-e503cb628098+9:2358:x1874712071366656:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 337us (984us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787865097.867205:0:15823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787865097.868346:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c317840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14359:1874712087073792:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787865097.868370:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787865097.868487:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6adbe011-80a1-414e-9ce7-e503cb628098+8:2359:x1874712071366528:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 8349us (9703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865097.868497:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787865097.876950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865097.877129:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366784 00000100:00100000:3.0:1787865097.877138:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366784 00000100:00100000:3.0:1787865097.877249:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787865097.877259:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+8:2359:x1874712071366784:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787865097.877314:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.877335:0:15058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 8 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.877343:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865097.877347:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787865097.877352:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.877433:0:15058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 8 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.877453:0:15058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 8 pid: 15056 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865097.877469:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15058:1874712087073920:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787865097.877552:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b83eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787865097.886956:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865097.887069:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15058:1874712087073920:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787865097.887081:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071366912 00000100:00100000:1.0:1787865097.887089:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071366912 00010000:00010000:3.0:1787865097.887096:0:15058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.887131:0:14358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 9 pid: 15056 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865097.889735:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787865097.889757:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+9:2358:x1874712071366912:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787865097.889774:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787865097.889798:0:14358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 9 pid: 15056 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.889814:0:14358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 9 pid: 15056 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.889864:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186192fe6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e2d expref: 9 pid: 15056 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.889880:0:14358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787865097.889884:0:14358:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787865097.889890:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.889901:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.889930:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787865097.889994:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6adbe011-80a1-414e-9ce7-e503cb628098+8:2358:x1874712071366912:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 246us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787865097.890002:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00010000:00010000:3.0:1787865097.890157:0:15058:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890168:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890193:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890201:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890230:0:15058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890237:0:15058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865097.890241:0:15058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890250:0:15058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890262:0:15058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.890273:0:15058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe186192fed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865097.890334:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adbe011-80a1-414e-9ce7-e503cb628098+7:2359:x1874712071366784:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 13076us (13404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787865097.890342:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787865097.893447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865097.893530:0:16610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367168 00000100:00100000:1.0:1787865097.893539:0:16610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367168 00000100:00100000:1.0:1787865097.893599:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:1.0:1787865097.893610:0:16610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adbe011-80a1-414e-9ce7-e503cb628098+14:14482:x1874712071367168:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787865097.893702:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.893719:0:16610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.893730:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.895994:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.896017:0:16610:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 15 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.896026:0:16610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.896060:0:16610:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 15 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.896074:0:16610:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 15 pid: 14372 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865097.896087:0:16610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16610:1874712087074048:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787865097.896177:0:16610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210ccab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787865097.901285:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.901605:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367296 00000100:00100000:0.0:1787865097.901614:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367296 00010000:00010000:0.0:1787865097.901662:0:14359:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 16 pid: 14372 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865097.901704:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787865097.901713:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6adbe011-80a1-414e-9ce7-e503cb628098+16:2359:x1874712071367296:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787865097.901727:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787865097.901735:0:14359:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 16 pid: 14372 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.901778:0:14359:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 16 pid: 14372 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.901800:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:0.0:1787865097.901806:0:14359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.901816:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.901827:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.901846:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787865097.901890:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203581600/0xa63eebe186192fc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7e18 expref: 16 pid: 14372 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865097.901910:0:16610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16610:1874712087074048:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787865097.901915:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6adbe011-80a1-414e-9ce7-e503cb628098+15:2359:x1874712071367296:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 199us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.901925:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:2.0:1787865097.901944:0:16610:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.901955:0:16610:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.901972:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787865097.902813:0:16610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787865097.904718:0:16610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787865097.904790:0:16610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787865097.904952:0:16610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22c316580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16610:1874712087074176:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787865097.905276:0:16610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787865097.905382:0:16610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23b454000 going to sleep for 11 seconds 00000100:00100000:2.0:1787865097.905649:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087074176 00000100:00100000:2.0:1787865097.905656:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087074176 00000100:00100000:2.0:1787865097.905766:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787865097.905775:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16610:x1874712087074176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787865097.905855:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16610:x1874712087074176:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787865097.905863:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787865097.905944:0:16610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22c316580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16610:1874712087074176:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787865097.906873:0:16610:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787865097.906950:0:16610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16610:1874712087074304:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787865097.907001:0:16610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787865097.907074:0:16610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa23bebb900 going to sleep for 11 seconds 00000100:00100000:2.0:1787865097.907119:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712087074304 00000100:00100000:2.0:1787865097.907125:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712087074304 00000100:00100000:2.0:1787865097.907243:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787865097.907252:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa23b0d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16610:x1874712087074304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787865097.907637:0:16610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa23b0d4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16610:1874712087074304:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787865097.907671:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907680:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907688:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907704:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a800 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865097.907709:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907716:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907730:0:16610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:1.0:1787865097.907733:0:16610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787865097.907738:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907744:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a800/0xa63eebe186192ffb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907770:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907776:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907780:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907785:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177a000 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:1.0:1787865097.907787:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907793:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907811:0:16610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:1.0:1787865097.907813:0:16610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787865097.907819:0:16610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907830:0:16610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907840:0:16610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865097.907865:0:16610:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177b600/0xa63eebe186192f5a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x252b8a25c00f7dfc expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787865097.907876:0:16610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa22f3f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16610:1874712087074432:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787865097.907951:0:16610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa210cca900 going to sleep for 11 seconds 00000100:00100000:2.0:1787865097.907994:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16610:x1874712087074304:12345-0@lo:1000:mdt00_004.0 Request processed in 169us (419us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787865097.908004:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787865097.913027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.913093:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367424 00000100:00100000:0.0:1787865097.913101:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367424 00000100:00100000:0.0:1787865097.913156:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787865097.913166:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22ea93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+19:14480:x1874712071367424:12345-192.168.206.10@tcp:49:dd.0 00000100:00100000:0.0:1787865097.913301:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22ea93450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+19:14480:x1874712071367424:12345-192.168.206.10@tcp:49:dd.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787865097.913308:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787865097.915591:0:16610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa22f3f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16610:1874712087074432:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787865097.915619:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.915629:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177a000/0xa63eebe186192f53 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918549:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918574:0:16610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918601:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918613:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918619:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918626:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918632:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203580400 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865097.918637:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918644:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918657:0:16610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:2.0:1787865097.918660:0:16610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787865097.918665:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918672:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa203580400/0xa63eebe186193002 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918686:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918692:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918704:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918710:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177ac00 already unused, calling callback (ffffffffc22294f0) 00010000:00010000:2.0:1787865097.918713:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.918720:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.919346:0:16610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa20e551100) 00010000:00010000:2.0:1787865097.919352:0:16610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787865097.919356:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865097.919363:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa21177ac00/0xa63eebe186192ff4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16610 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865097.919821:0:16610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa23b0d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adbe011-80a1-414e-9ce7-e503cb628098+18:14482:x1874712071367168:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 26206us (26376us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787865097.919832:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000020:00080000:2.0:1787865097.919838:0:16610:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787865097.922679:0:14404:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787865097.922688:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787865097.922718:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787865097.922724:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787865097.936174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865097.936265:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367680 00000100:00100000:0.0:1787865097.936283:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367680 00000100:00100000:0.0:1787865097.936335:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787865097.936356:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+18:14482:x1874712071367680:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787865097.937109:0:14375:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787865097.937238:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787865097.937280:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937296:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937307:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937315:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937321:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937326:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865097.937415:0:14375:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787865097.937498:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22f3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adbe011-80a1-414e-9ce7-e503cb628098+20:14482:x1874712071367680:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1142us (1331us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787865097.937506:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000020:00080000:0.0:1787865097.937511:0:14375:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787865097.938180:0:14360:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787865097.938188:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.938196:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865097.938200:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.938207:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.938263:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa20e551d00) 00010000:00010000:3.0:1787865097.938322:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787865097.938328:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.938334:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa242164a00/0xa63eebe186193009 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865097.938347:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865097.938348:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787865097.938350:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787865098.119238:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787865098.119298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787865098.119548:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367936 00000100:00100000:3.0:1787865098.119559:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367936 00000100:00100000:3.0:1787865098.119657:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071367808 00000100:00100000:3.0:1787865098.119661:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071367808 00000100:00100000:3.0:1787865098.119685:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787865098.119696:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+8:2357:x1874712071367936:12345-192.168.206.10@tcp:4:dd.0 00002000:00010000:3.0:1787865098.119754:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a90a809, atime: 0x6a90a808, ctime: 0x6a90a809, blocks: 0x1 00010000:00010000:3.0:1787865098.119764:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.119780:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787865098.119785:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865098.119791:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.119814:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787865098.120943:0:14368:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787865098.133895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787865098.134109:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787865098.134119:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787865098.134231:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368064 00000100:00100000:1.0:1787865098.134241:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368064 00000100:00100000:0.0:1787865098.134626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865098.134664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865098.134682:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865098.134697:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368192 00000100:00100000:0.0:1787865098.134707:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368192 00000100:00100000:0.0:1787865098.134729:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865098.134735:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368448 00000100:00100000:0.0:1787865098.134738:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368448 00000100:00100000:0.0:1787865098.134770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865098.134781:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865098.134785:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368320 00000100:00100000:0.0:1787865098.134788:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368320 00000100:00100000:0.0:1787865098.134816:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865098.134825:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865098.134830:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368576 00000100:00100000:0.0:1787865098.134833:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368576 00000100:00100000:0.0:1787865098.134866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787865098.134877:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787865098.134884:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874712071368704 00000100:00100000:0.0:1787865098.134887:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874712071368704 00000100:00100000:1.0:1787865098.135577:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787865098.135589:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+15:2357:x1874712071367808:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:1.0:1787865098.135627:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865098.135644:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865098.135648:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787865098.135654:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787865098.135668:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787865098.227720:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1787865098.227752:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1787865098.227760:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1787865098.229854:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1787865098.229862:0:15063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787865097 -> 1787865098 00002000:00010000:2.0:1787865098.229864:0:15063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787865097 -> 1787865098 00002000:00010000:2.0:1787865098.229867:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1787865098.229892:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229904:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229913:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229919:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b351000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865098.229924:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229942:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229962:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.229970:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008faa582d/0xa63eebe186193010 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865098.230071:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+15:2357:x1874712071367936:12345-192.168.206.10@tcp:4:dd.0 Request processed in 110373us (110840us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787865098.230085:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787865098.230114:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787865098.230124:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa22c3152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+14:2356:x1874712071368064:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787865098.230162:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.230174:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865098.230178:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865098.230184:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.230195:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787865098.278600:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1787865098.278765:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:0.0:1787865098.278783:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278796:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278804:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278811:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa21177b400 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865098.278815:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278839:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278858:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.278865:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b986f311/0xa63eebe186193017 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865098.278983:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c315680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+14:2357:x1874712071367808:12345-192.168.206.10@tcp:4:dd.0 Request processed in 143392us (159680us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787865098.278993:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787865098.279024:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787865098.279035:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+13:2356:x1874712071368192:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:0.0:1787865098.279068:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.279080:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.279085:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.279091:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.279103:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787865098.322722:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1787865098.322995:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787865098.323001:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1787865098.323016:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323029:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323038:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323060:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581a00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865098.323065:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323074:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323103:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323111:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022cb4e67/0xa63eebe18619301e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865098.323199:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa22c3152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+13:2356:x1874712071368064:12345-192.168.206.10@tcp:4:dd.0 Request processed in 93074us (189309us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787865098.323208:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787865098.323241:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787865098.323252:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+12:2357:x1874712071368448:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:3.0:1787865098.323297:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323310:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865098.323315:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787865098.323322:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.323348:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787865098.361640:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1787865098.366029:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1787865098.366038:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1787865098.366052:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366064:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366072:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366079:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865098.366083:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366092:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366113:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366120:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe186193025 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865098.366217:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa21015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+12:2356:x1874712071368192:12345-192.168.206.10@tcp:4:dd.0 Request processed in 87181us (231589us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787865098.366236:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787865098.366281:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787865098.366294:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+11:2357:x1874712071368320:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:0.0:1787865098.366326:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366339:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.366343:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.366349:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.366362:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.371014:0:14361:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787865098.395347:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:0.0:1787865098.395829:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395844:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395852:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395859:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa23b350200 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865098.395864:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395893:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395913:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.395920:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2eadae7/0xa63eebe18619302c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865098.396014:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+11:2357:x1874712071368448:12345-192.168.206.10@tcp:4:dd.0 Request processed in 72762us (261345us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787865098.396024:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787865098.396055:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787865098.396066:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+10:2356:x1874712071368576:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:0.0:1787865098.396096:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.396109:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.396113:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787865098.396120:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.396132:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787865098.431255:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1787865098.438436:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1787865098.438446:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1787865098.438463:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438477:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438486:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438500:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242164000 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:2.0:1787865098.438506:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438530:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438552:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438560:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000092cd384/0xa63eebe186193033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787865098.438724:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+10:2357:x1874712071368320:12345-192.168.206.10@tcp:4:dd.0 Request processed in 72430us (303949us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787865098.438735:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787865098.438773:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787865098.438787:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa20c1d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+9:2357:x1874712071368704:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787865098.438820:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438834:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865098.438838:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787865098.438845:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787865098.438856:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787865098.473257:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1787865098.473643:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1787865098.473661:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473675:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473684:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473692:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa242165800 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:0.0:1787865098.473696:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473706:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473854:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787865098.473863:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000807fe28f/0xa63eebe18619303a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787865098.473961:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6adbe011-80a1-414e-9ce7-e503cb628098+9:2356:x1874712071368576:12345-192.168.206.10@tcp:4:dd.0 Request processed in 77894us (339139us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787865098.474178:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000001:00080000:0.0:1787865098.522069:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1787865098.522446:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787865098.522462:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522475:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522489:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522496:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa203581e00 already unused, calling callback (ffffffffc17d6530) 00010000:00010000:3.0:1787865098.522501:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522509:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522528:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787865098.522535:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4326a95/0xa63eebe186193041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787865098.522792:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa20c1d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6adbe011-80a1-414e-9ce7-e503cb628098+5:2357:x1874712071368704:12345-192.168.206.10@tcp:4:dd.0 Request processed in 84005us (387919us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787865098.522803:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:2.0:1787865099.387633:0:15831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787865099.818334:0:16652:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787865100.411902:0:14360:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28879 lines, 28879 kept, 0 dropped, 0 bad.